Applied AI Engineer
Build, operate, and improve production LLM-backed agent systems while establishing rigorous evaluation, testing, monitoring, and code-review practices. This individual contributor role also coaches teammates and raises engineering standards across the AI and Data team.
About the job
Responsibilities
- Build LLM-backed agent systems end to end and deploy them for internal users.
- Design evaluation suites and monitoring before production release.
- Review agent pull requests and establish durable software design standards.
- Operate production systems, triage model drift and silent failures, and fix root causes.
- Define and promote engineering conventions for testing, structure, and error handling.
- Pair with and coach teammates, including analysts and engineers newer to software development.
- Assess when AI is not the appropriate solution for a problem.
Requirements
- Strong programming fundamentals and the ability to reason about unfamiliar code.
- Experience building and operating production systems relied upon by others.
- A testing- and evaluation-driven approach to shipping software.
- Ability to provide actionable code reviews and coach teammates.
- High engineering standards focused on measurable outcomes.
Compensation and Benefits
- Competitive pay and equity with significant upside.
- Flexible schedules and time off.
- Sabbatical after every five years of service.
- Healthy and well-balanced employee benefits.
Skills
LLMs, Python, Software Testing, Evaluation Design, Monitoring, Code Review, Production Systems, Error Handling
Similar jobs
ML Engineering jobs
Baseten
San Francisco, CA
Build and ship AI-powered agents, automations, dashboards, and integrations that improve GPU capacity operations across Compute and C3. The role requires 3+ years of AI automation or technical operations experience, production Vercel expertise, agent-tool fluency, and strong API integration skills.
Anthropic
San Francisco, CABuild and optimize a high-scale LLM inference engine spanning accelerator programming, host-device coordination, and distributed systems. The role requires strong systems programming, performance analysis, and an understanding of LLM inference across compute, memory, and interconnects.
OnePay
United States
Build and operate production AI agents, automation workflows, and integrations that improve complex business processes. The role requires 5+ years of software engineering experience, modern LLM and agent-framework expertise, systems integration skills, and strong cross-functional collaboration.
Thinking Machines Lab
San Francisco, CA
Build and operate the engineering systems that support post-training research, including reinforcement learning infrastructure, sandboxed execution, data pipelines, and agent scaffolding. The role requires strong Python and systems engineering skills, project ownership, and a relevant bachelor’s degree or equivalent experience.
OpenAI
San Francisco, CA
Build research infrastructure and tooling that enables AI models to design silicon, including reinforcement learning environments, EDA integrations, evaluations, and experiment workflows. The role requires strong software engineering fundamentals and comfort working across research, tooling, and chip-design systems.