# Staff Software Engineer, Foundation Model API

**Company:** [Databricks](https://hotfix.jobs/companies/databricks)
**Location:** San Francisco, CA
**Role:** ML Engineering
**Salary:** $190k – $265k/yr
**Experience:** 8+ years
**Skills:** Distributed Systems, scalable apis, cloud native infrastructure, real-time serving, ML Infrastructure, gpu orchestration, service-oriented architecture, deployment pipelines, system observability, Scala, Go, Python, SageMaker, vertex ai, azure ml
**Posted:** 2026-07-16

> Build and shape the Foundation Model API serving layer for large-scale LLM inference (partner and self-hosted models) at Databricks. Requires 8+ years backend/infra engineering experience with distributed systems, ML infrastructure, and a strong product ownership mindset.

## Job Description

## Impact
- Build LLM infrastructure powering large-scale inference workloads for customers through partner models (OpenAI, Anthropic, Gemini) and self-hosted models (Qwen, GPT-OSS, Llama)
- Shape the direction of the FMAPI product — from roadmap to execution — by leveraging deep customer empathy and direct engagement with enterprise users and model providers
- Improve reliability, latency, and efficiency of distributed AI workloads
- Collaborate with platform, infra, and ML teams to deliver seamless end-to-end experiences
- Shape how developers and data scientists build and interact with AI on Databricks

## Requirements
- 8+ years of experience in backend or infrastructure engineering
- Experience with distributed systems, scalable APIs, or cloud-native infrastructure
- Strong product and ownership mindset, with a focus on shipping user-facing value
- Experience with real-time serving, ML infrastructure, or GPU orchestration
- Familiarity with service-oriented architecture, deployment pipelines, and system observability
- Strong programming skills in Scala, Go, or Python

## Nice-to-Haves
- Exposure to platforms like SageMaker, Vertex AI, or Azure ML
- Built products that support AI workflows

## Similar roles

- [Staff Software Engineer - AI Research Infrastructure](https://hotfix.jobs/jobs/2c266640-f094-4349-bffc-06f3b2934de3) - Databricks - New York, NY - $190k – $270k/yr
- [Staff Software Engineer, AI Runtime](https://hotfix.jobs/jobs/2ea7944c-45ee-4f48-8c85-a9ae03a53b15) - Databricks - Mountain View, CA - $190k – $265k/yr
- [Staff Machine Learning Engineer](https://hotfix.jobs/jobs/d1943f91-7f1d-4c37-840b-24ef6a11d96b) - Databricks - San Francisco, CA - $190k – $285k/yr
- [Staff Machine Learning Engineer, Computer Vision](https://hotfix.jobs/jobs/2969c5c0-8479-43bb-b9b6-f8df93b528d7) - Pinterest - San Francisco, CA - $189k – $390k/yr
- [Staff Machine Learning Engineer](https://hotfix.jobs/jobs/3c08f024-1b6c-4c43-86de-db177792a225) - Pinterest - San Francisco, CA - $189k – $390k/yr

**Apply:** https://hotfix.jobs/jobs/ff6221ee-31ff-478f-ba5b-a23b7ecb914e
**Canonical:** https://hotfix.jobs/jobs/ff6221ee-31ff-478f-ba5b-a23b7ecb914e