# Staff Software Engineer, Agents

**Company:** [Harvey](https://hotfix.jobs/companies/harvey)
**Location:** New York, NY
**Role:** ML Engineering
**Salary:** $231k – $340k/yr
**Experience:** 7+ years
**Skills:** Python, LLM APIs, Agent Frameworks, Prompt Engineering, eval harness development, observability tools, caching strategies, parallel tool calls, subagent patterns
**Posted:** 2026-07-22

> Build and optimize AI agents for legal workflows at Harvey. Design environments, actions, evaluations, tools, and infrastructure for high-performance domain-specific agents using LLMs.

## Job Description

## What You'll Do
- Partner with customers and PMs to understand legal workflows, design practical evaluations that capture what “excellent” means, and ship agents that get the job done.
- Optimize agent performance through prompt engineering, model selection, tool design, skill writing, context window management, and eval harness development.
- Work with our model infra team to design and implement infrastructure for low-latency agent execution, including caching strategies, parallel tool calls, or subagent patterns.
- Improve our observability and instrumentation to profile agent behavior, identify bottlenecks, and drive optimization decisions.
- Stay current on new developments in agentic systems and bring those learnings back to the products we build.

## What You Have
- Passion for building effective domain-specific agents.
- Iterative mindset: you develop proof of concepts, make decisions quickly, and ship v0s.
- Comfortable with when and how to use evaluations to drive quality.
- Humble and adaptable about code and frameworks. We expect you to drive adoption of new best practices as they develop.
- 5-8 years (post-BS/MS) of software engineering experience.
- Proficiency in Python and experience working with LLM APIs and agent frameworks.
- Experience with shipping user-facing products, either on the backend or full-stack.

## Similar roles

- [Staff Software Engineer, Agents](https://hotfix.jobs/jobs/a97dd7fb-bd69-4449-8010-971ab051bbfa) - Harvey - San Francisco, CA - $231k – $340k/yr
- [Staff Software Engineer, AI Platform](https://hotfix.jobs/jobs/0786beca-d2bb-4de3-8134-cd87ca1563aa) - Harvey - San Francisco, CA - $231k – $340k/yr
- [Senior Staff Engineer, Autonomy Integration](https://hotfix.jobs/jobs/02060c2b-675d-4f99-ab79-3fa9bd27c55f) - Shield AI - San Diego, CA - $230k – $350k/yr
- [Senior Staff Engineer, Discrete Planning](https://hotfix.jobs/jobs/ade67494-dfeb-41f9-a008-d152230c3549) - Shield AI - San Diego, CA - $230k – $350k/yr
- [Staff Machine Learning Engineer, Notifications Relevance](https://hotfix.jobs/jobs/5df4bbf6-982b-4563-aaee-d477695b1557) - Reddit - Remote - $230k – $322k/yr

**Apply:** https://hotfix.jobs/jobs/ac459a95-310e-4c4a-8329-03b5cd7432b3
**Canonical:** https://hotfix.jobs/jobs/ac459a95-310e-4c4a-8329-03b5cd7432b3