# Staff Backend Software Engineer

**Company:** [Databricks](https://hotfix.jobs/companies/databricks)
**Location:** New York, NY
**Role:** Backend Engineering
**Salary:** $190k – $261k/yr
**Experience:** 8+ years
**Skills:** Scala, Go, Python, Distributed Systems, Scalable Apis, Cloud-Native Infrastructure, Service-Oriented Architecture, MLflow, PyTorch, Ray
**Posted:** 2026-03-18

> Builds LLM infrastructure for AI workloads, improves reliability and efficiency of distributed systems, and collaborates with ML teams. Requires 8+ years backend experience with Scala, Go, or Python, and expertise in distributed systems.

## Job Description

## The impact you will have:
- Build LLM infrastructure powering trillions of tokens per week for customers through partner models (OpenAI, Anthropic, Gemini) and self hosted models (Qwen, GPT-OSS, Llama)
- Improve reliability, latency, and efficiency of distributed AI workloads
- Collaborate with platform, infra, and ML teams to deliver seamless end-to-end experiences
- Shape how developers and data scientists build and interact with AI on Databricks

## What we look for:
- 8+ years of experience in backend or infrastructure engineering
- Strong programming skills in **Scala, Go, or Python**
- Experience with distributed systems, scalable APIs, or cloud-native infrastructure
- Familiarity with service-oriented architecture, deployment pipelines, and system observability
- Strong product and ownership mindset — you care about building the right solution, not just any solution

## Bonus points for:
- Experience with real-time serving, ML infrastructure, or GPU orchestration
- Exposure to platforms like SageMaker, Vertex AI, or Azure ML
- Contributions to OSS projects like MLflow, PyTorch, Ray, vLLM, SGLang
- Built developer platforms or internal tools supporting AI workflows

## Similar roles

- [Staff Software Engineer](https://hotfix.jobs/jobs/7d7e49f7-5548-4c99-82a5-c6ca8019a3b4) - Checkr - Denver, CO - $190k – $264k/yr
- [Senior/Staff Software Engineer, Database Team](https://hotfix.jobs/jobs/f63d426d-b264-4de4-aba3-ead37bf4a021) - Pinecone - New York, NY - $190k – $270k/yr
- [Staff Software Engineer, Backend](https://hotfix.jobs/jobs/00576e7c-2ab3-4728-a479-eb7c6d31f373) - Creditgenie - New York, NY - $190k – $250k/yr
- [Staff Software Engineer, Metrics and Logging](https://hotfix.jobs/jobs/416e2090-376a-499b-b7ea-656daa1b5db1) - Databricks - Mountain View, CA - $190k – $261k/yr
- [Staff Backend Engineer](https://hotfix.jobs/jobs/f3987ec5-0e69-4aec-8026-4ada08fe6581) - OpenSea - Remote - $190k – $345k/yr

**Apply:** https://hotfix.jobs/jobs/2c57d348-2ddb-4da3-9b30-c56075bfb132
**Canonical:** https://hotfix.jobs/jobs/2c57d348-2ddb-4da3-9b30-c56075bfb132