# Software Engineer, AI Platform

**Company:** [Harvey](https://hotfix.jobs/companies/harvey)
**Location:** San Francisco, CA
**Role:** ML Engineering
**Salary:** $185k – $325k/yr
**Experience:** 5+ years
**Skills:** Backend Systems, ai/ml engineering, multi-model ai systems, model routing, context management, Evaluation Frameworks, SDKs, Agentic AI, function calling, Distributed Systems
**Posted:** 2026-03-12

> Build core AI platform infrastructure at Harvey including model routing, context management, evaluation frameworks, and shared abstractions for agentic AI products. Requires 5+ years backend experience with 1+ year in AI/ML, production multi-model systems, and strong platform-building skills.

## Job Description

## What You’ll Do
- Design and build abstractions and platform-level systems that improve all of Harvey’s agentic products.
- Own infrastructure for model integration, routing, and evaluation that helps Harvey choose and deploy the right foundation model for any given context.
- Build evaluation frameworks and tooling that let every team across Harvey iterate on AI quality effectively.
- Partner closely with product engineering teams, PMs, and design to launch cutting-edge AI products.
- Evaluate, prototype, and integrate the latest advancements in AI and agentic systems as they emerge.

## What You Have
- 5+ years of experience building backend systems, with at least 1+ year focused on AI/ML engineering. Staff candidates will typically have 8+ years and a track record of technical leadership across teams.
- Experience building and shipping multi-model or multi-provider AI systems in production.
- Familiarity with context management, session state, or memory systems in AI or distributed systems.
- A track record of building internal platforms, SDKs, or shared infrastructure that other engineering teams actually adopted.
- Strong judgment about abstractions and opinionated about good design but pragmatic about shipping incrementally.
- Excitement about agentic AI and the infrastructure challenges of making autonomous systems reliable.
- A bias toward full ownership: you navigate ambiguity well and don’t wait for a roadmap to start solving problems.

## Bonus
- Experience building evaluation frameworks.
- Working with agent/function-calling architectures.
- Familiarity with legal or other high-stakes professional services domains.
- Time at early-stage or hyper-growth startups where the underlying technology changes regularly.

## Compensation
$220,000 - $300,000

## Similar roles

- [ML Research Engineer - Hardware Codesign](https://hotfix.jobs/jobs/d026c059-6f98-4851-8cac-4d288d1fa389) - OpenAI - San Francisco, CA - $185k – $455k/yr
- [Software Engineer, AI Safety](https://hotfix.jobs/jobs/909a18c3-50f0-48ce-9d5f-ba967e7badbe) - OpenAI - San Francisco, CA - $185k – $325k/yr
- [Machine Learning Engineer, Ads Optimization & Ads Marketplace Quality](https://hotfix.jobs/jobs/1b6a57d4-f904-4b39-9f4f-b4537e33b7e7) - Reddit - Remote - $186k – $303k/yr
- [Software Engineer, Machine Learning Platform](https://hotfix.jobs/jobs/8227a48c-d3ba-4a85-afb5-a934accf63b3) - Chime - San Francisco, CA - $187k – $259k/yr
- [Agentic AI Engineer](https://hotfix.jobs/jobs/d74d66cb-3089-4707-b593-9f9e90c11b05) - EigenLayer - Remote - $187k – $253k/yr

**Apply:** https://hotfix.jobs/jobs/868d9456-eda3-4d16-9848-636e8b2e1da0
**Canonical:** https://hotfix.jobs/jobs/868d9456-eda3-4d16-9848-636e8b2e1da0