Skip to content
HarveyHarveySan Francisco, CA

Staff Software Engineer, Agents

Builds AI agent systems for legal workflows, optimizing performance via prompt engineering, model selection, tools, and evaluations. Partners with customers/PMs to ship low-latency agents using Python and LLM APIs; requires 8+ years experience.

231k – 340k/yr
Hybrid8+ YOEML Engineering

About the role

What You'll Do

  • Partner with customers and PMs to understand legal workflows, design practical evaluations that capture what “excellent” means, and ship agents that get the job done.
  • Optimize agent performance through prompt engineering, model selection, tool design, skill writing, context window management, and eval harness development.
  • Work with our model infra team to design and implement infrastructure for low-latency agent execution, including caching strategies, parallel tool calls, or subagent patterns.
  • Improve our observability and instrumentation to profile agent behavior, identify bottlenecks, and drive optimization decisions.
  • Stay current on new developments in agentic systems and bring those learns back to the products we build.

What You Have

  • Passion for building effective domain-specific agents.
  • Iterative mindset: you develop proof of concepts, make decisions quickly, and ship v0s.
  • Comfortable with when and how to use evaluations to drive quality.
  • Humble and adaptable about code and frameworks. We expect you to drive adoption of new best practices as they develop.
  • 8+ years (post-BS/MS) of software engineering experience. We are hiring for this role across Mid, Senior, and Staff levels.
  • Proficiency in Python and experience working with LLM APIs and agent frameworks.
  • Experience with shipping user-facing products, either on the backend or full-stack.

Compensation Range

$231,000 - $340,000 USD

Skills

PythonLLM APIsAgent FrameworksPrompt EngineeringModel SelectionTool DesignContext Window ManagementEval HarnessObservabilityInstrumentation

Similar roles

ML Engineering jobs
Reddit

Staff Machine Learning Engineer

RedditSan Francisco, CA

Staff Machine Learning Engineer designing, training, and deploying advanced ML models (DNNs, transformers, RL) for Reddit's large-scale online advertising ranking, optimization, and marketplace systems. Requires Master's, 3+ years experience, technical leadership, and expertise in production ML systems.

230k – 322k/yr
Remote7+ YOEML Engineering
Reddit

Staff Machine Learning Engineer, Notifications Relevance

RedditUnited States

Technical leader for Reddit's Notifications Relevance ML systems, driving large-scale recommendation systems spanning retrieval, ranking, budget optimization, and LLM-powered experiences.

230k – 322k/yr
Remote8+ YOEML Engineering
Reddit

Staff Machine Learning Engineer, Ads Measurement Modeling

RedditUnited States

Leads technical strategy, architecture, and development of advanced ML models for ads identity modeling and measurement, ensuring scalability, privacy compliance, and integration across systems. Requires 7+ years software engineering with 3+ in ML at scale, expertise in ML frameworks and large-scale data processing.

230k – 322k/yr
Remote7+ YOEML Engineering
Fractional AI

Senior / Staff Software Engineer (SF/NY)

Fractional AISan Francisco, CA +1

Senior/Staff Software Engineer builds end-to-end AI products for clients, spending 75% time coding and 25% with stakeholders like CTOs. Requires 8+ years experience shipping products, applying software engineering to AI systems with high ownership.

230k – 350k/yr
Hybrid8+ YOEML Engineering
Betterment

Sr. Staff Engineer

BettermentNew York, NY

Leads AI platform strategy and infrastructure for deploying AI features across Betterment's products, partnering with product, compliance, and engineering teams. Requires deep LLM expertise, fullstack experience with React/GraphQL/server languages, and production AI operations in a regulated environment.

230k – 270k/yr
HybridML Engineering