# Staff Software Engineer, AI Platform

**Company:** [Harvey](https://hotfix.jobs/companies/harvey)
**Location:** San Francisco, CA, New York, NY
**Role:** Backend Engineering
**Salary:** $231k – $340k/yr
**Experience:** 5+ years
**Skills:** Python, AI/ML, Machine Learning, Backend Systems, Model Routing, Context Management, Evaluation Frameworks, SDKs, Agentic AI, Multi-Model Systems
**Posted:** 2026-04-24

> Builds AI platform infrastructure including model integration, routing, context management, and evaluation tooling to power agentic products. Requires 5+ years backend experience with 1+ year AI/ML focus and track record of shared platforms.

## Job Description

## What You’ll Do
- Design and build abstractions and platform-level systems that improve all of Harvey’s agentic products.
- Own infrastructure for model integration, routing, and evaluation that helps Harvey choose and deploy the right foundation model for any given context.
- Build evaluation frameworks and tooling that let every team across Harvey iterate on AI quality effectively.
- Partner closely with product engineering teams, PMs, and design to launch cutting-edge AI products.
- Evaluate, prototype, and integrate the latest advancements in AI and agentic systems as they emerge.

## What You Have
- 5+ years of experience building backend systems, with at least 1+ year focused on AI/ML engineering. Staff candidates will typically have 8+ years and a track record of technical leadership across teams.
- Experience building and shipping multi-model or multi-provider AI systems in production.
- Familiarity with context management, session state, or memory systems in AI or distributed systems. You’ve thought about what the model sees and why it matters.
- A track record of building internal platforms, SDKs, or shared infrastructure that other engineering teams actually adopted - and an understanding of why developer experience matters as much as raw capability.
- Strong judgment about abstractions. Opinionated about good design but pragmatic about shipping incrementally.
- Excitement about agentic AI and the infrastructure challenges of making autonomous systems reliable when the stakes are real.
- A bias toward full ownership: you navigate ambiguity well and don’t wait for a roadmap to start solving problems.

**Bonus:** experience building evaluation frameworks, working with agent/function-calling architectures, familiarity with legal or other high-stakes professional services domains, or time at early-stage or hyper-growth startups where the underlying technology changes regularly.

## Compensation Range
$231,000 - $340,000

## Similar roles

- [Staff Software Engineer, Backend](https://hotfix.jobs/jobs/2d8695c8-2c5e-4964-8617-5e32312693ca) - Harvey - San Francisco, CA - $231k – $340k/yr
- [Staff Software Engineer](https://hotfix.jobs/jobs/a77b152b-1449-47f3-ae51-4bdc7baa3fcf) - Tines - Remote - $230k – $250k/yr
- [Software Architect](https://hotfix.jobs/jobs/8b901b0f-55af-4428-9aad-768257c998bd) - Machinify - Remote - $230k – $280k/yr
- [Senior Member of Technical Staff](https://hotfix.jobs/jobs/14c428b1-f836-4085-98f3-0cf788f59d52) - Anterior - New York, NY - $230k – $300k/yr
- [Staff Software Engineer](https://hotfix.jobs/jobs/71353045-738d-4930-9200-b3c2d308dc08) - Maybern - New York, NY - $230k – $270k/yr

**Apply:** https://hotfix.jobs/jobs/63dc3ecf-1dde-4a3a-93e1-4e9c7f32657e
**Canonical:** https://hotfix.jobs/jobs/63dc3ecf-1dde-4a3a-93e1-4e9c7f32657e