# Staff Software Engineer, Agents

**Company:** [Harvey](https://hotfix.jobs/companies/harvey)
**Location:** San Francisco, CA, New York, NY
**Role:** ML Engineering
**Salary:** $231k – $340k/yr
**Experience:** 8+ years
**Skills:** Python, LLM APIs, Agent Frameworks, Prompt Engineering, Model Selection, Tool Design, Context Window Management, Eval Harness, Observability, Instrumentation
**Posted:** 2026-05-01

> Builds AI agent systems for legal workflows, optimizing performance via prompt engineering, model selection, tools, and evaluations. Partners with customers/PMs to ship low-latency agents using Python and LLM APIs; requires 8+ years experience.

## Job Description

## What You'll Do

- Partner with customers and PMs to understand legal workflows, design practical evaluations that capture what “excellent” means, and ship agents that get the job done.
- Optimize agent performance through prompt engineering, model selection, tool design, skill writing, context window management, and eval harness development.
- Work with our model infra team to design and implement infrastructure for low-latency agent execution, including caching strategies, parallel tool calls, or subagent patterns.
- Improve our observability and instrumentation to profile agent behavior, identify bottlenecks, and drive optimization decisions.
- Stay current on new developments in agentic systems and bring those learns back to the products we build.

## What You Have

- Passion for building effective domain-specific agents.
- Iterative mindset: you develop proof of concepts, make decisions quickly, and ship v0s.
- Comfortable with when and how to use evaluations to drive quality.
- Humble and adaptable about code and frameworks. We expect you to drive adoption of new best practices as they develop.
- 8+ years (post-BS/MS) of software engineering experience. We are hiring for this role across Mid, Senior, and Staff levels.
- **Proficiency in Python** and experience working with **LLM APIs** and **agent frameworks**.
- Experience with shipping user-facing products, either on the backend or full-stack.

## Compensation Range

**$231,000 - $340,000 USD**

## Similar roles

- [Staff Machine Learning Engineer](https://hotfix.jobs/jobs/ebc73812-e806-404d-9f4e-435da967dbf5) - Reddit - Remote - $230k – $322k/yr
- [Staff Machine Learning Engineer, Notifications Relevance](https://hotfix.jobs/jobs/5df4bbf6-982b-4563-aaee-d477695b1557) - Reddit - Remote - $230k – $322k/yr
- [Staff Machine Learning Engineer, Ads Measurement Modeling](https://hotfix.jobs/jobs/66ae67c8-cd05-42e4-9ea4-9f913dc37d43) - Reddit - Remote - $230k – $322k/yr
- [Senior / Staff Software Engineer (SF/NY)](https://hotfix.jobs/jobs/21b3e63e-16d5-4495-a4eb-cb797436d773) - Fractional AI - San Francisco, CA - $230k – $350k/yr
- [Sr. Staff Engineer](https://hotfix.jobs/jobs/592ff4db-35fb-49ec-9f4c-1aff059846c7) - Betterment - New York, NY - $230k – $270k/yr

**Apply:** https://hotfix.jobs/jobs/a97dd7fb-bd69-4449-8010-971ab051bbfa
**Canonical:** https://hotfix.jobs/jobs/a97dd7fb-bd69-4449-8010-971ab051bbfa