Lead design and development of Harvey's Model Infrastructure platform powering all AI requests, including unified model controller, intelligent routing, multi-provider integrations, observability, and capacity management for high reliability, low latency, and efficiency. Requires 7+ years building large-scale distributed systems with strong programming and leadership skills; AI/LLM infrastructure experience preferred.
236k – 290k/yr
On-site7+ YOEML Engineering
Staff Software Engineer, Agents
HarveyNew York, NY
Build and optimize AI agents for legal workflows at Harvey. Design environments, actions, evaluations, tools, and infrastructure for high-performance domain-specific agents using LLMs.
231k – 340k/yr
Hybrid7+ YOEML Engineering
Senior Software Engineer, AI Platform
HarveySan Francisco, CA +1
Build core AI platform infrastructure at Harvey including model routing, context management, agent architecture, and shared evaluation frameworks that power all agentic legal AI products. Requires 5+ years backend experience with 1+ year in AI/ML, production multi-model systems, and platform-building track record.
193k – 290k/yr
Hybrid5+ YOEML Engineering
Research Engineer, Post-Training
HarveySan Francisco, CA
Research engineer focused on post-training LLMs and agents for legal work. Requires hands-on experience training open-weight models and strong Python/research engineering skills.
231k – 340k/yr
HybridML Engineering
Staff Software Engineer, Agents
HarveySan Francisco, CA +1
Builds AI agent systems for legal workflows, optimizing performance via prompt engineering, model selection, tools, and evaluations. Partners with customers/PMs to ship low-latency agents using Python and LLM APIs; requires 8+ years experience.
231k – 340k/yr
Hybrid8+ YOEML Engineering
Software Engineer, Agents
HarveySan Francisco, CA +1
Builds AI agents for legal workflows, optimizing performance via prompt engineering, model selection, tools, and evaluations. Partners with PMs and customers to ship low-latency, high-quality agent systems using Python and LLM APIs. Requires 2-5 years experience.
161k – 242k/yr
Hybrid2+ YOEML Engineering
Staff Software Engineer, AI Platform
HarveySan Francisco, CA +1
Build core AI platform infrastructure at Harvey including model routing, context engineering, agent infrastructure, and shared evaluation frameworks that power all agentic legal AI products. Requires 8+ years backend experience with 1+ year AI/ML focus and track record of technical leadership.
231k – 340k/yr
Hybrid8+ YOEML Engineering
Software Engineer, AI Platform
HarveySan Francisco, CA
Build core AI platform infrastructure at Harvey including model routing, context management, evaluation frameworks, and shared abstractions for agentic AI products. Requires 5+ years backend experience with 1+ year in AI/ML, production multi-model systems, and strong platform-building skills.
185k – 325k/yr
Hybrid5+ YOEML Engineering
Mid/Senior/Staff Software Engineer, Agents
HarveySan Francisco, CA +1
Build AI agent systems for legal workflows, optimizing performance via prompt engineering, model selection, tools, and evals. Requires 3+ years experience, Python proficiency, and LLM/agent framework expertise for mid/senior/staff levels.
165k – 312k/yr
On-siteML Engineering
Search
Location
9 jobs
Job results
Staff Software Engineer, Model Infrastructure
HarveySan Francisco, CA
Lead design and development of Harvey's Model Infrastructure platform powering all AI requests, including unified model controller, intelligent routing, multi-provider integrations, observability, and capacity management for high reliability, low latency, and efficiency. Requires 7+ years building large-scale distributed systems with strong programming and leadership skills; AI/LLM infrastructure experience preferred.
236k – 290k/yr
On-site7+ YOEML Engineering
Staff Software Engineer, Agents
HarveyNew York, NY
Build and optimize AI agents for legal workflows at Harvey. Design environments, actions, evaluations, tools, and infrastructure for high-performance domain-specific agents using LLMs.
231k – 340k/yr
Hybrid7+ YOEML Engineering
Senior Software Engineer, AI Platform
HarveySan Francisco, CA +1
Build core AI platform infrastructure at Harvey including model routing, context management, agent architecture, and shared evaluation frameworks that power all agentic legal AI products. Requires 5+ years backend experience with 1+ year in AI/ML, production multi-model systems, and platform-building track record.
193k – 290k/yr
Hybrid5+ YOEML Engineering
Research Engineer, Post-Training
HarveySan Francisco, CA
Research engineer focused on post-training LLMs and agents for legal work. Requires hands-on experience training open-weight models and strong Python/research engineering skills.
231k – 340k/yr
HybridML Engineering
Staff Software Engineer, Agents
HarveySan Francisco, CA +1
Builds AI agent systems for legal workflows, optimizing performance via prompt engineering, model selection, tools, and evaluations. Partners with customers/PMs to ship low-latency agents using Python and LLM APIs; requires 8+ years experience.
231k – 340k/yr
Hybrid8+ YOEML Engineering
Software Engineer, Agents
HarveySan Francisco, CA +1
Builds AI agents for legal workflows, optimizing performance via prompt engineering, model selection, tools, and evaluations. Partners with PMs and customers to ship low-latency, high-quality agent systems using Python and LLM APIs. Requires 2-5 years experience.
161k – 242k/yr
Hybrid2+ YOEML Engineering
Staff Software Engineer, AI Platform
HarveySan Francisco, CA +1
Build core AI platform infrastructure at Harvey including model routing, context engineering, agent infrastructure, and shared evaluation frameworks that power all agentic legal AI products. Requires 8+ years backend experience with 1+ year AI/ML focus and track record of technical leadership.
231k – 340k/yr
Hybrid8+ YOEML Engineering
Software Engineer, AI Platform
HarveySan Francisco, CA
Build core AI platform infrastructure at Harvey including model routing, context management, evaluation frameworks, and shared abstractions for agentic AI products. Requires 5+ years backend experience with 1+ year in AI/ML, production multi-model systems, and strong platform-building skills.
185k – 325k/yr
Hybrid5+ YOEML Engineering
Get new-job notifications on iOS
Hotfix on iOS
Get a push summary when new jobs match your saved alerts.
Mid/Senior/Staff Software Engineer, Agents
HarveySan Francisco, CA +1
Build AI agent systems for legal workflows, optimizing performance via prompt engineering, model selection, tools, and evals. Requires 3+ years experience, Python proficiency, and LLM/agent framework expertise for mid/senior/staff levels.