# Staff Software Engineer

**Company:** [Databricks](https://hotfix.jobs/companies/databricks)
**Location:** San Francisco, CA
**Role:** ML Engineering
**Salary:** $190k – $265k/yr
**Experience:** 8+ years
**Skills:** Distributed Systems, scalable apis, cloud native infrastructure, real-time serving, ML Infrastructure, gpu orchestration, service-oriented architecture, deployment pipelines, system observability, SageMaker, vertex ai, azure ml, MLflow, PyTorch, Ray
**Posted:** 2026-07-24

> Build and optimize LLM inference infrastructure at enterprise scale for partner and self-hosted frontier models. Requires 8+ years backend/infrastructure engineering experience with distributed systems, real-time serving, and ML/GPU orchestration.

## Job Description

## Impact
- Build LLM infrastructure powering large-scale inference workloads for customers through partner models (OpenAI, Anthropic, Gemini) and self-hosted models (Qwen, GPT-OSS, Llama)
- Improve reliability, latency, and efficiency of distributed AI workloads
- Collaborate with platform, infra, and ML teams to deliver seamless end-to-end experiences
- Shape how developers and data scientists build and interact with AI on Databricks

## Requirements
- 8+ years of experience in backend or infrastructure engineering
- Experience with distributed systems, scalable APIs, or cloud-native infrastructure
- Experience with real-time serving, ML infrastructure, or GPU orchestration
- Familiarity with service-oriented architecture, deployment pipelines, and system observability

## Nice-to-Haves
- Exposure to platforms like SageMaker, Vertex AI, or Azure ML
- Contributions to OSS projects like MLflow, PyTorch, Ray, vLLM, SGLang
- Built developer platforms or internal tools supporting AI workflows

## Similar roles

- [Staff Engineer, AI Platform & Architecture](https://hotfix.jobs/jobs/4b0a95da-6689-4664-abdc-0883deda231b) - Shield AI - Remote - $190k – $290k/yr
- [Staff Software Engineer - AI Research Infrastructure](https://hotfix.jobs/jobs/2c266640-f094-4349-bffc-06f3b2934de3) - Databricks - New York, NY - $190k – $270k/yr
- [Staff Software Engineer, Foundation Model API](https://hotfix.jobs/jobs/ff6221ee-31ff-478f-ba5b-a23b7ecb914e) - Databricks - San Francisco, CA - $190k – $265k/yr
- [Staff Software Engineer, AI Runtime](https://hotfix.jobs/jobs/2ea7944c-45ee-4f48-8c85-a9ae03a53b15) - Databricks - Mountain View, CA - $190k – $265k/yr
- [Staff Machine Learning Engineer](https://hotfix.jobs/jobs/d1943f91-7f1d-4c37-840b-24ef6a11d96b) - Databricks - San Francisco, CA - $190k – $285k/yr

**Apply:** https://hotfix.jobs/jobs/f4888fb1-6e90-4a9f-b6eb-4ce370c10086
**Canonical:** https://hotfix.jobs/jobs/f4888fb1-6e90-4a9f-b6eb-4ce370c10086