Skip to content
HarveyHarvey

Mid/Senior/Staff Software Engineer, Agents

Build AI agent systems for legal workflows, optimizing performance via prompt engineering, model selection, tools, and evals. Requires 3+ years experience, Python proficiency, and LLM/agent framework expertise for mid/senior/staff levels.

About the job

Representative Projects

  • Save weeks of effort on high pressure M&A deals by automating information requests and diligence checks across hundreds of thousands of files with retrieval and file editing agents.
  • Dramatically speed up deal turnaround speed by improving the latency and quality of agents on applying a standard legal "playbook" to contracts.
  • Ensure that our clients win their complex, data-hungry litigation cases by optimizing our multi-source retrieval agents.
  • Enable board-ready PowerPoint generation by tuning the harness and libraries for coding agents.

What You'll Do

  • Partner with customers and PMs to understand legal workflows, design practical evaluations that capture what “excellent” means, and ship agents that get the job done.
  • Optimize agent performance through prompt engineering, model selection, tool design, skill writing, context window management, and eval harness development.
  • Work with our model infra team to design and implement infrastructure for low-latency agent execution, including caching strategies, parallel tool calls, or subagent patterns.
  • Improve our observability and instrumentation to profile agent behavior, identify bottlenecks, and drive optimization decisions.
  • Stay current on new developments in agentic systems and bring those learnings back to the products we build.

What You Have

  • Passion for building effective domain-specific agents.
  • Iterative mindset: you develop proof of concepts, make decisions quickly, and ship v0s.
  • Comfortable with when and how to use evaluations to drive quality.
  • Humble and adaptable about code and frameworks. We expect you to drive adoption of new best practices as they develop.
  • 3+ years (post-BS/MS) of software engineering experience.
  • We are hiring for this role across Mid, Senior, and Staff levels.
  • Proficiency in Python and experience working with LLM APIs and agent frameworks.
  • Experience with shipping user-facing products, either on the backend or full-stack.

Compensation Range

$165,000 - $312,000 USD

Skills

Python, LLM APIs, Agent Frameworks, Prompt Engineering, Evaluations, Observability, Model Selection, Context Window Management, Tool Design, Caching Strategies

OnePay

OnePay

United States

Staff Applied Scientist, Personalization
$180k+/yrRemote7+ YOEML Engineering

Design and productionize ML, deep learning, and LLM models for personalization, recommendations, and search systems. Requires 7+ years building production ML/AI with business impact and strong cross-functional collaboration skills.

Talkiatry

Talkiatry

United States

Staff AI Enablement Engineer
$190k+/yrRemote8+ YOEML Engineering

Staff-level engineer responsible for building AI agents and automation, evaluating developer AI tools, and driving adoption across the engineering organization. Requires 8+ years of software engineering experience plus production experience with LLMs, agentic systems, and applied machine learning.

Nuro

Nuro

Mountain View, CA

Senior/Staff Engineer, Machine Learning - Online Mapping
$194k+/yrOn-site7+ YOEML Engineering

Develop and productize online mapping models for autonomous navigation using real-world sensor data. The role requires deep ML expertise, robotics or computer vision experience, strong Python and deep learning framework skills, and a staff-level ability to deliver practical solutions.

Nuro

Nuro

Mountain View, CA

Senior/Staff Software Engineer, ML Inference Platform
$194k+/yrOn-site5+ YOEML Engineering

Build and operate ML infrastructure for autonomy teams, including training and deployment pipelines, model observability, inference serving, and compiler platforms across hardware targets. Requires a degree, 3+ years of relevant experience, Python proficiency, and distributed-systems expertise.

Shield AI

Shield AI

San Diego, CA

Staff Engineer, Perception Software
$200k+/yrOn-site7+ YOEML Engineering

Develop production C++ perception capabilities for autonomous systems, spanning algorithms, libraries, integration, validation, and release. The role requires deep expertise in at least one perception domain, strong systems debugging, and experience delivering maintainable software in complex robotics or real-time environments.