Staff Software Engineer, Agents
Builds AI agent systems for legal workflows, optimizing performance via prompt engineering, model selection, tools, and evaluations. Partners with customers/PMs to ship low-latency agents using Python and LLM APIs; requires 8+ years experience.
About the job
What You'll Do
- Partner with customers and PMs to understand legal workflows, design practical evaluations that capture what “excellent” means, and ship agents that get the job done.
- Optimize agent performance through prompt engineering, model selection, tool design, skill writing, context window management, and eval harness development.
- Work with our model infra team to design and implement infrastructure for low-latency agent execution, including caching strategies, parallel tool calls, or subagent patterns.
- Improve our observability and instrumentation to profile agent behavior, identify bottlenecks, and drive optimization decisions.
- Stay current on new developments in agentic systems and bring those learns back to the products we build.
What You Have
- Passion for building effective domain-specific agents.
- Iterative mindset: you develop proof of concepts, make decisions quickly, and ship v0s.
- Comfortable with when and how to use evaluations to drive quality.
- Humble and adaptable about code and frameworks. We expect you to drive adoption of new best practices as they develop.
- 8+ years (post-BS/MS) of software engineering experience. We are hiring for this role across Mid, Senior, and Staff levels.
- Proficiency in Python and experience working with LLM APIs and agent frameworks.
- Experience with shipping user-facing products, either on the backend or full-stack.
Compensation Range
$231,000 - $340,000 USD
Skills
Python, LLM APIs, Agent Frameworks, Prompt Engineering, Model Selection, Tool Design, Context Window Management, Eval Harness, Observability, Instrumentation
Similar jobs
ML Engineering jobs
Harvey
San Francisco, CA
Leads the design and operation of reliable, scalable model infrastructure powering AI inference across multiple providers. Requires 7+ years of distributed-systems engineering experience, strong programming skills, and expertise in production reliability and cloud infrastructure.
Shield AI
San Mateo, CA
Leads the design, implementation, integration, and field validation of tactical autonomy and multi-agent coordination capabilities for unmanned platforms. Requires 7+ years of relevant experience, production C++, technical leadership, and eligibility for a U.S. Secret clearance.
Snowflake
Bellevue, WA
Leads the roadmap and technical vision for Snowflake Feature Store, building reliable, high-performance machine learning platform capabilities and supporting technical execution across partner teams. Requires 10+ years of experience with data-serving infrastructure or ML platforms, plus Java and Python expertise.
Shield AI
Washington, DCLeads development and integration of advanced maritime autonomy for USVs, UUVs, and cooperating UAVs, including motion planning, localization, safety, and multi-agent coordination. Requires staff-level technical leadership, substantial robotics experience, C++ and Python proficiency, and eligibility for a SECRET clearance.
Ironclad
San Francisco, CA
Leads architecture and technical direction for agentic search systems combining LLMs, retrieval, and content-understanding pipelines for contract intelligence. The role requires 10+ years building production systems, deep search or LLM expertise, and strong cross-team technical leadership.