# Software Engineer, Agents

**Company:** [Harvey](https://hotfix.jobs/companies/harvey)
**Location:** San Francisco, CA, New York, NY
**Role:** ML Engineering
**Salary:** $161k – $242k/yr
**Experience:** 2+ years
**Skills:** Python, LLM APIs, Agent Frameworks, Prompt Engineering, Model Selection, Tool Design, Context Window Management, Eval Harness, Observability, Instrumentation
**Posted:** 2026-05-01

> Builds AI agents for legal workflows, optimizing performance via prompt engineering, model selection, tools, and evaluations. Partners with PMs and customers to ship low-latency, high-quality agent systems using Python and LLM APIs. Requires 2-5 years experience.

## Job Description

## What You'll Do

- Partner with customers and PMs to understand legal workflows, design practical evaluations that capture what “excellent” means, and ship agents that get the job done.
- Optimize agent performance through prompt engineering, model selection, tool design, skill writing, context window management, and eval harness development.
- Work with our model infra team to design and implement infrastructure for low-latency agent execution, including caching strategies, parallel tool calls, or subagent patterns.
- Improve our observability and instrumentation to profile agent behavior, identify bottlenecks, and drive optimization decisions.
- Stay current on new developments in agentic systems and bring those learnings back to the products we build.

## What You Have

- Passion for building effective domain-specific agents.
- Iterative mindset: you develop proof of concepts, make decisions quickly, and ship v0s.
- Comfortable with when and how to use evaluations to drive quality.
- Humble and adaptable about code and frameworks. We expect you to drive adoption of new best practices as they develop.
- 2-5 years (post-BS/MS) of software engineering experience. We are hiring for this role across Mid, Senior, and Staff levels.
- Proficiency in Python and experience working with LLM APIs and agent frameworks.
- Experience with shipping user-facing products, either on the backend or full-stack.

## Compensation Range

$161,300 - $241,900 USD

## Similar roles

- [Software Engineer, ML Infrastructure, Optimization](https://hotfix.jobs/jobs/a6b5f42b-e6f7-497c-adda-7a35b24c3eb4) - Nuro - Mountain View, CA - $160k – $241k/yr
- [Software Engineer, Model Performance Tooling](https://hotfix.jobs/jobs/26ede8a1-a8ce-494b-bcb9-87270ba2d333) - Baseten - San Francisco, CA - $160k – $200k/yr
- [Machine Learning Engineer, Monetization Engineering](https://hotfix.jobs/jobs/717f63ae-bbd1-483c-9c49-b2a025ed411d) - Pinterest - San Francisco, CA - $163k – $286k/yr
- [Software Engineer](https://hotfix.jobs/jobs/823e27ee-a56e-4d3e-ac4d-dacbce6de23d) - Abridge - San Francisco, CA - $157k – $184k/yr
- [Machine Learning Engineer, Relevance and Personalization](https://hotfix.jobs/jobs/e55bff4d-9948-4fd5-8f5e-51f0f5c17db4) - Airbnb - Remote - $166k – $195k/yr

**Apply:** https://hotfix.jobs/jobs/c48c3d5d-396e-4051-938f-a677c38c294d
**Canonical:** https://hotfix.jobs/jobs/c48c3d5d-396e-4051-938f-a677c38c294d