Software Engineer, Automation
Builds autonomous agent systems for internal operations using Python and LLM APIs, including MCP servers, evaluation frameworks, and workflow orchestration. Owns end-to-end backend infrastructure with focus on reliability and real-world impact.
About the job
What You’ll Do
- Build and maintain MCP servers that give agents structured access to Mercor’s platform — reading project state, taking management actions, and triggering communications.
- Design and implement evaluation frameworks to measure agent decision quality and drive continuous improvement through feedback loops.
- Develop action queues and playbook orchestration systems that allow agents to execute multi-step workflows with conditional logic.
- Instrument agent systems end-to-end — capturing outcomes, closing feedback loops, and enabling hill-climbing on eval metrics.
- Collaborate directly with operators to identify high-leverage automation opportunities and translate them into robust agent behaviors.
- Debug and harden agent systems in production, designing for reliability at scale.
- Contribute to foundational patterns and infrastructure that the rest of the company will build on.
What We’re Looking For
- Strong backend engineering fundamentals in Python (or equivalent modern language).
- Experience building with LLM APIs — including tool use, structured outputs, and multi-step reasoning workflows.
- Comfort designing evaluation frameworks and thinking rigorously about agent failure modes.
- Ability to ship quickly and iterate on systems that interact with the real world.
- Understanding of distributed systems, APIs, and production infrastructure.
- Full-stack experience is a plus — owning features end-to-end will increase your impact.
Benefits
- Generous equity grant vested over 4 years
- A $10K housing bonus (if you live within 0.5 miles of our office)
- A $1.5K monthly stipend for meals
- Free Equinox membership
- Health insurance
Skills
Python, LLM APIs, Distributed Systems, APIs, Production Infrastructure, Mcp Servers, Evaluation Frameworks, Action Queues, Playbook Orchestration, Observability
Similar jobs
Backend Engineering jobs
OnePay
United States
Builds backend services and APIs for fraud detection, identity verification, and transaction monitoring in fintech. Requires 3+ years backend experience with APIs, microservices, AWS, and Kubernetes.
Mercor
San Francisco, CA
Build and operate production backend services and agent infrastructure powering talent workflows, including orchestration, evaluation, guardrails, and auditable decision systems. The role requires 5+ years of backend engineering experience, distributed-systems expertise, and hands-on experience with production LLM applications.
Mercor
San Francisco, CA
Software Engineer building core backend systems for a high-volume AI talent marketplace, including matching, allocation, search, and real-time decisioning infrastructure. Requires strong production backend experience with high-throughput APIs and distributed systems.
Mintlify
San Francisco, CA
Build backend APIs, content pipelines, and AI retrieval infrastructure powering Mintlify’s documentation products. The role requires strong systems design, API, database, and production experience, along with product intuition and high ownership.
Bestow
United States
Build and scale Go backend services for insurance quoting and application-submission tools, collaborating across product teams and partners. The role requires 3+ years of backend development experience, distributed systems and API expertise, Docker, CI/CD, testing, and practical use of AI coding tools.