Staff Software Engineer, Backend - Platform
Leads the architecture and development of production agentic AI systems, distributed infrastructure, APIs, orchestration, guardrails, and evaluation frameworks for scalable automation. Requires 8+ years of software engineering experience and demonstrated expertise shipping AI/ML applications and reliable LLM-based systems.
About the job
Responsibilities
- Architect and build agentic AI systems for compliance automation and other operations, including intelligent agents, orchestration, and guardrails.
- Design foundational APIs and measurement frameworks to ensure AI agents are grounded, relevant, and reliable.
- Lead technical direction for distributed systems underpinning AI automation, including architecture patterns and strategic roadmaps.
- Build reusable primitives and orchestration solutions that scale AI-powered automation across multiple domains.
- Mentor engineers on AI system design, coding standards, and production-readiness practices for LLM-based applications.
Requirements
- 8+ years of software engineering experience.
- Experience architecting distributed systems and shipping production AI/ML applications.
- Experience with LLM-based applications, including measuring and improving grounding, reducing hallucinations, and building reliability guardrails.
- Deep expertise designing APIs, orchestration layers, and evaluation frameworks for agentic AI systems at scale.
Compensation & Benefits
- Annual base salary: $218,025–$256,500 USD, excluding equity and bonus.
- Equity and bonus eligibility.
- Medical, dental, and vision benefits.
- 401(k).
Skills
Distributed Systems, Artificial Intelligence, Machine Learning, LLMs, APIs, Orchestration, Guardrails, Evaluation Frameworks, Grounding, Hallucination Reduction, Production Systems, Python
Similar jobs
Backend Engineering jobs
Coinbase
United States
Staff Software Engineer building distributed backend platforms and infrastructure for customer service and compliance workflows. The role requires 8+ years of experience, deep Go expertise, cloud and DevOps skills, architectural leadership, and engineer mentorship.
Coinbase
United States
Own and evolve Coinbase’s large-scale application routing infrastructure across Kubernetes, Envoy, and Istio. The role requires 8+ years in software and infrastructure engineering, strong systems programming and AWS experience, and expertise in distributed systems and service networking.
Idme
Mountain View, CA
Leads the architecture and hands-on development of internal developer platforms, AI-agent workflows, and distributed automation infrastructure. Requires 8+ years of software engineering experience, Staff-level technical leadership, and strong backend, microservices, and event-driven architecture expertise.
Liftoff
United States
Designs and operates high-throughput, low-latency ad-serving infrastructure, including GPU-based model inference and feature stores. Requires 10+ years of industry experience, strong computer science fundamentals, and a master’s degree in computer science or equivalent experience.
Jasper
United States
Leads the technical vision for Jasper’s integration pod, architecting secure, scalable data-ingestion systems and IQ-layer context primitives that power AI experiences. Requires 8+ years of software engineering experience, staff-level technical leadership, distributed-systems expertise, and familiarity with AI and external marketing platforms.