Staff Backend Software Engineer- (AI Platform)
166k – 225kSan Francisco, CAOnsite5+ YOE
Summary
Builds infrastructure powering Databricks' AI platform including MLflow, AI Gateway, and model serving. Requires 5+ years backend experience with Scala, Go, or Python, and expertise in distributed systems and scalable APIs.
About the role
Impact/Responsibilities
- Build infrastructure that powers flagship offerings like MLflow, AI Gateway, Databricks Apps, Agent Framework, Agent Bricks, and Foundation Model APIs.
- Improve reliability, latency, and efficiency of distributed AI workloads.
- Collaborate with platform, infra, and ML teams to deliver seamless end-to-end experiences.
- Shape how developers and data scientists build and interact with AI on Databricks.
Requirements
- 5+ years of experience in backend or infrastructure engineering.
- Strong programming skills in Scala, Go, or Python.
- Experience with distributed systems, scalable APIs, or cloud-native infrastructure.
- Familiarity with service-oriented architecture, deployment pipelines, and system observability.
- Strong product and ownership mindset.
Nice-to-Haves
- Experience with real-time serving, ML infrastructure, or GPU orchestration.
- Exposure to platforms like SageMaker, Vertex AI, or Azure ML.
- Contributions to OSS projects like MLflow, PyTorch, or Ray.
- Built developer platforms or internal tools supporting AI workflows.
Skills
ScalaGoPythonDistributed SystemsScalable APIsCloud-Native InfrastructureService-Oriented ArchitectureMLflowML InfrastructureGPU Orchestration
Similar roles at this salary range
All Backend Engineering jobs →Staff Backend Engineer
Staff Backend Engineer to architect and scale voice AI systems for 911 centers, optimizing realtime pipelines and integrating with customer systems. Requires 6+ years of experience and strong engineering fundamentals.
180k – 240kSeattle, WABackend EngineeringOn-siteGoSQL