# Senior Software Engineer, Foundation Model API

**Company:** [Databricks](https://hotfix.jobs/companies/databricks)
**Location:** San Francisco, CA
**Role:** ML Engineering
**Salary:** $160k – $225k/yr
**Experience:** 8+ years
**Skills:** Distributed Systems, Scalable Apis, Cloud Native Infrastructure, Real-Time Serving, ML Infrastructure, Gpu Orchestration, Service-Oriented Architecture, Deployment Pipelines, System Observability, Scala, Go, Python, SageMaker, Vertex Ai, Azure Ml
**Posted:** 2026-07-15

> Build and shape the Foundation Model API serving layer for large-scale LLM inference at Databricks, bridging technical execution with product strategy for partner and self-hosted models. Requires 8+ years backend/infra engineering experience with distributed systems, real-time serving, and strong product ownership.

## Job Description

## Impact
- Build LLM infrastructure powering large-scale inference workloads for customers through partner models (OpenAI, Anthropic, Gemini) and self-hosted models (Qwen, GPT-OSS, Llama)
- Shape the direction of the FMAPI product — from roadmap to execution — by leveraging deep customer empathy and direct engagement with enterprise users and model providers
- Improve reliability, latency, and efficiency of distributed AI workloads
- Collaborate with platform, infra, and ML teams to deliver seamless end-to-end experiences
- Shape how developers and data scientists build and interact with AI on Databricks

## Requirements
- 8+ years of experience in backend or infrastructure engineering
- Experience with distributed systems, scalable APIs, or cloud-native infrastructure
- Strong product and ownership mindset, with a focus on shipping user-facing value
- Experience with real-time serving, ML infrastructure, or GPU orchestration
- Familiarity with service-oriented architecture, deployment pipelines, and system observability
- Strong programming skills in Scala, Go, or Python

## Nice-to-Haves
- Exposure to platforms like SageMaker, Vertex AI, or Azure ML
- Built products that support AI workflows

## Similar roles

- [Senior Software Engineer](https://hotfix.jobs/jobs/9c6f27b3-b45e-4193-81ee-1d1c057d363d) - Pearl Health - Remote - $160k – $200k/yr
- [Senior Software Engineer](https://hotfix.jobs/jobs/423c60aa-ca4c-400d-babe-a50099433cbb) - SpotOn - Chicago, IL - $160k – $190k/yr
- [Senior Engineer, Applied AI](https://hotfix.jobs/jobs/fde322de-5f40-47c3-81b1-e7c042bd1df2) - Honor - Remote - $160k – $180k/yr
- [Senior Software Engineer, AI Runtime](https://hotfix.jobs/jobs/f56a1580-de92-4d64-bf6f-dcedbf8b8082) - Databricks - Mountain View, CA - $160k – $225k/yr
- [Senior AI Engineer](https://hotfix.jobs/jobs/2716f0ca-948f-41b7-83c2-06362589b8a7) - Octus - New York, NY - $160k – $170k/yr

**Apply:** https://hotfix.jobs/jobs/08d8d8ab-55f4-4265-b6a8-798b492eb14d
**Canonical:** https://hotfix.jobs/jobs/08d8d8ab-55f4-4265-b6a8-798b492eb14d