Staff Backend Software Engineer
Builds LLM infrastructure for AI workloads, improves reliability and efficiency of distributed systems, and collaborates with ML teams. Requires 8+ years backend experience with Scala, Go, or Python, and expertise in distributed systems.
About the job
The impact you will have:
- Build LLM infrastructure powering trillions of tokens per week for customers through partner models (OpenAI, Anthropic, Gemini) and self hosted models (Qwen, GPT-OSS, Llama)
- Improve reliability, latency, and efficiency of distributed AI workloads
- Collaborate with platform, infra, and ML teams to deliver seamless end-to-end experiences
- Shape how developers and data scientists build and interact with AI on Databricks
What we look for:
- 8+ years of experience in backend or infrastructure engineering
- Strong programming skills in Scala, Go, or Python
- Experience with distributed systems, scalable APIs, or cloud-native infrastructure
- Familiarity with service-oriented architecture, deployment pipelines, and system observability
- Strong product and ownership mindset — you care about building the right solution, not just any solution
Bonus points for:
- Experience with real-time serving, ML infrastructure, or GPU orchestration
- Exposure to platforms like SageMaker, Vertex AI, or Azure ML
- Contributions to OSS projects like MLflow, PyTorch, Ray, vLLM, SGLang
- Built developer platforms or internal tools supporting AI workflows
Skills
Scala, Go, Python, Distributed Systems, Scalable Apis, Cloud-Native Infrastructure, Service-Oriented Architecture, MLflow, PyTorch, Ray
Similar jobs
Backend Engineering jobs
Checkr
Denver, COStaff software engineer responsible for architecture and hands-on development of complex screening and verification workflows across product engineering teams. Requires 10+ years of software development experience, deep backend expertise, and leadership in scalable, reliable systems.
Rippling
New York, NYStaff Software Engineer leading architecture and implementation for Rippling’s Spend platform, which unifies corporate cards, reimbursements, procurement, bill pay, and travel. The role requires 8+ years of backend and distributed-systems experience, strong architectural judgment, and technical leadership across teams.
Rippling
New York, NYStaff backend-leaning software engineer responsible for foundational systems powering onboarding, self-serve purchasing, and shared Core Experience infrastructure. The role requires 8+ years of software engineering experience, strong systems design and data modeling skills, and the ability to own scalable features end-to-end.
Rippling
Seattle, WAStaff engineer leading architecture, development, and operational excellence for highly available workforce time and attendance systems. The role requires 8+ years of backend experience with Python, Django, PostgreSQL, and MongoDB, plus technical leadership and mentorship.
Rula
United States
Staff Software Engineer responsible for shaping and delivering scalable marketplace systems that improve provider utilization and patient access. The role requires 8+ years of software engineering experience, cross-team technical leadership, and hands-on backend development.