Skip to content
DatabricksDatabricksSan Francisco, CA

Staff Backend Software Engineer- (AI Platform)

Builds infrastructure powering Databricks' AI platform including MLflow, AI Gateway, and model serving. Requires 5+ years backend experience with Scala, Go, or Python, and expertise in distributed systems and scalable APIs.

166k – 225k/yr
On-site5+ YOEBackend Engineering

About the role

Impact/Responsibilities

  • Build infrastructure that powers flagship offerings like MLflow, AI Gateway, Databricks Apps, Agent Framework, Agent Bricks, and Foundation Model APIs.
  • Improve reliability, latency, and efficiency of distributed AI workloads.
  • Collaborate with platform, infra, and ML teams to deliver seamless end-to-end experiences.
  • Shape how developers and data scientists build and interact with AI on Databricks.

Requirements

  • 5+ years of experience in backend or infrastructure engineering.
  • Strong programming skills in Scala, Go, or Python.
  • Experience with distributed systems, scalable APIs, or cloud-native infrastructure.
  • Familiarity with service-oriented architecture, deployment pipelines, and system observability.
  • Strong product and ownership mindset.

Nice-to-Haves

  • Experience with real-time serving, ML infrastructure, or GPU orchestration.
  • Exposure to platforms like SageMaker, Vertex AI, or Azure ML.
  • Contributions to OSS projects like MLflow, PyTorch, or Ray.
  • Built developer platforms or internal tools supporting AI workflows.

Skills

ScalaGoPythonDistributed SystemsScalable ApisCloud-Native InfrastructureService-Oriented ArchitectureMLflowML InfrastructureGpu Orchestration

Similar roles

Backend Engineering jobs
Zus Health

Staff Software Engineer, Platform

Zus HealthMassachusetts

Staff Software Engineer building and operating scalable data services and APIs on AWS for healthcare records processing and delivery at massive scale. Requires strong Go backend experience, cloud data warehouse knowledge, technical leadership, and interest in healthcare data challenges.

170k – 200k/yr
Remote7+ YOEBackend Engineering
Chainguard

Staff Software Engineer

ChainguardUnited States

Own a major domain end-to-end building Athena, the enterprise-scale clearing house for vulnerability data. Design and ship production Go systems on GCP that ingest, deduplicate, and route security signals.

170k – 231k/yr
Remote7+ YOEBackend Engineering
Illumio

Sr. Member of Technical Staff, Architecture

IllumioSunnyvale, CA

Senior engineer developing containerized microservices in Java/Spring Boot or Go for a distributed multi-tenant security platform on Kubernetes. Owns full SDLC, mentors juniors, and operates production systems serving real-time cloud telemetry.

170k – 196k/yr
On-site5+ YOEBackend Engineering
Sardine

Staff Backend Engineer

SardineUnited States

Leads development of backend systems for compliance platform including KYC, sanctions screening, transaction monitoring, and regulatory reporting. Requires 7+ years backend experience, ideally in Golang, with high-throughput data processing and integrations in regulated environments.

170k – 600k/yr
Remote7+ YOEBackend Engineering
Mithril

Software Engineer - Member of Technical Staff (Platform)

MithrilUnited States

Build and maintain Python backend APIs, orchestration for GPU capacity marketplace, supply integrations with cloud providers, and developer tooling across full stack for AI infrastructure platform handling real workloads and revenue.

170k – 230k/yr
HybridBackend Engineering