# Mid/Senior/Staff Software Engineer, Agents

**Company:** [Harvey](https://hotfix.jobs/companies/harvey)
**Location:** San Francisco, CA, New York, NY
**Role:** ML Engineering
**Salary:** $165k – $312k/yr
**Skills:** Python, LLM APIs, Agent Frameworks, Prompt Engineering, Evaluations, Observability, Model Selection, Context Window Management, Tool Design, Caching Strategies
**Posted:** 2026-01-31

> Build AI agent systems for legal workflows, optimizing performance via prompt engineering, model selection, tools, and evals. Requires 3+ years experience, Python proficiency, and LLM/agent framework expertise for mid/senior/staff levels.

## Job Description

## Representative Projects
- Save weeks of effort on high pressure M&A deals by automating information requests and diligence checks across hundreds of thousands of files with retrieval and file editing agents.
- Dramatically speed up deal turnaround speed by improving the latency and quality of agents on applying a standard legal "playbook" to contracts.
- Ensure that our clients win their complex, data-hungry litigation cases by optimizing our multi-source retrieval agents.
- Enable board-ready PowerPoint generation by tuning the harness and libraries for coding agents.

## What You'll Do
- Partner with customers and PMs to understand legal workflows, design practical evaluations that capture what “excellent” means, and ship agents that get the job done.
- Optimize agent performance through prompt engineering, model selection, tool design, skill writing, context window management, and eval harness development.
- Work with our model infra team to design and implement infrastructure for low-latency agent execution, including caching strategies, parallel tool calls, or subagent patterns.
- Improve our observability and instrumentation to profile agent behavior, identify bottlenecks, and drive optimization decisions.
- Stay current on new developments in agentic systems and bring those learnings back to the products we build.

## What You Have
- Passion for building effective domain-specific agents.
- Iterative mindset: you develop proof of concepts, make decisions quickly, and ship v0s.
- Comfortable with when and how to use evaluations to drive quality.
- Humble and adaptable about code and frameworks. We expect you to drive adoption of new best practices as they develop.
- **3+ years (post-BS/MS) of software engineering experience.**
- We are hiring for this role across Mid, Senior, and Staff levels.
- **Proficiency in Python and experience working with LLM APIs and agent frameworks.**
- Experience with shipping user-facing products, either on the backend or full-stack.

## Compensation Range
**$165,000 - $312,000 USD**

## Similar roles

- [Senior Staff AI & Agentic Systems Engineer](https://hotfix.jobs/jobs/5aca3ad2-37ed-432f-acc7-d7916c850288) - Mozilla - Remote - $166k – $260k/yr
- [Retirement AI Staff Engineer](https://hotfix.jobs/jobs/307cb3aa-0135-4f07-9cbd-f1109c32fd31) - Gusto - Denver, CO - $164k – $247k/yr
- [Staff Software Engineer, AI Search](https://hotfix.jobs/jobs/0fb6896f-890f-465e-8866-968f76175ae7) - Databricks - Mountain View, CA - $166k – $225k/yr
- [Staff Machine Learning Engineer, Modeling, Support](https://hotfix.jobs/jobs/b84e00c9-8344-47b4-b00a-50ec694df6cd) - Square - Seattle, WA - $161k – $284k/yr
- [Senior / Staff Software Engineer](https://hotfix.jobs/jobs/f23e3c2b-6a0e-4f62-a932-7681b5efa73e) - Clear Street - Remote - $170k – $240k/yr

**Apply:** https://hotfix.jobs/jobs/77110eb4-a2f2-4725-98fc-709a6b518954
**Canonical:** https://hotfix.jobs/jobs/77110eb4-a2f2-4725-98fc-709a6b518954