# Engineering Manager, Foundation Model Inference

**Company:** [Databricks](https://hotfix.jobs/companies/databricks)
**Location:** Mountain View, CA
**Role:** Engineering Management
**Salary:** $190k – $261k/yr
**Experience:** 5+ years
**Skills:** Distributed Systems, ai/ml infrastructure, large-scale backend services, Roadmapping, Incident Response, postmortems, Team Management, hiring, Coaching
**Posted:** 2026-07-22

> Lead and grow a team of infrastructure engineers building Databricks' Foundation Model Inference and APIs for serving partner and self-hosted LLMs at scale. Shape roadmaps for real-time, provisioned, and batch inference while maintaining high reliability, operational excellence, and technical quality.

## Job Description

## Impact You Will Have
- Lead and grow a team of talented, product-minded infrastructure Engineers working on Databricks Foundation Model Inference and Foundation Model API. The team owns the systems powering large-scale inference workloads for customers through partner models (OpenAI, Anthropic, Gemini) and self-hosted models (Qwen, GPT-OSS, Llama).
- Help shape the roadmap for products spanning real-time inference, provisioned throughput, and batch inference use cases.
- Partner closely with product and engineering leadership to deliver the right capabilities with strong reliability, quality, and service health.
- Build an inclusive, high-performing team that attracts, develops, and retains exceptional engineers.
- Maintain a deep understanding of your team’s technical area and uphold a strong bar for architecture, implementation quality, and operational excellence.

## What We Look For
- Experience managing and growing high-performing software engineering teams.
- Strong technical judgment in distributed systems, platform infrastructure, AI/ML infrastructure, or large-scale backend services, with the ability to maintain quality even in areas you have not worked on personally.
- A track record of delivering complex, multi-quarter engineering initiatives with high quality and predictable execution.
- Experience partnering effectively with product management and peer engineering teams to translate customer and business needs into roadmaps and shipped outcomes.
- Operational rigor, including experience with service health, incident response, postmortems, and continuous improvement.
- Excellent communication, coaching, and hiring skills.
- BS in Computer Science or related field.

## Similar roles

- [Engineering Manager, Compute Services](https://hotfix.jobs/jobs/8ae0f1f8-52e1-4e90-93a8-e6339b7ad160) - 1Password - Remote - $190k – $278k/yr
- [Engineering Manager, Managed Credentials](https://hotfix.jobs/jobs/35664570-9ff7-4f45-9665-12fa0cb9aaf6) - 1Password - Remote - $190k – $278k/yr
- [Engineering Manager, R&D](https://hotfix.jobs/jobs/3405d272-b85d-4c36-820e-a3e38e5a68ac) - Commure - Mountain View, CA - $190k – $230k/yr
- [Engineering Manager, Authentication Services](https://hotfix.jobs/jobs/5c333851-4567-4870-a95e-3c59174e6fe5) - 1Password - Remote - $190k – $278k/yr
- [Engineering Manager](https://hotfix.jobs/jobs/fdb3d18d-aee5-42b9-b4ee-3193e1ac946c) - Steno - Remote - $190k – $230k/yr

**Apply:** https://hotfix.jobs/jobs/6e6fe53a-525e-43b3-b91c-6f902a2541b0
**Canonical:** https://hotfix.jobs/jobs/6e6fe53a-525e-43b3-b91c-6f902a2541b0