Skip to content
DatabricksDatabricksNew York, NY

Staff Backend Software Engineer

Builds LLM infrastructure for AI workloads, improves reliability and efficiency of distributed systems, and collaborates with ML teams. Requires 8+ years backend experience with Scala, Go, or Python, and expertise in distributed systems.

190k – 261k/yr
On-site8+ YOEBackend Engineering

About the role

The impact you will have:

  • Build LLM infrastructure powering trillions of tokens per week for customers through partner models (OpenAI, Anthropic, Gemini) and self hosted models (Qwen, GPT-OSS, Llama)
  • Improve reliability, latency, and efficiency of distributed AI workloads
  • Collaborate with platform, infra, and ML teams to deliver seamless end-to-end experiences
  • Shape how developers and data scientists build and interact with AI on Databricks

What we look for:

  • 8+ years of experience in backend or infrastructure engineering
  • Strong programming skills in Scala, Go, or Python
  • Experience with distributed systems, scalable APIs, or cloud-native infrastructure
  • Familiarity with service-oriented architecture, deployment pipelines, and system observability
  • Strong product and ownership mindset — you care about building the right solution, not just any solution

Bonus points for:

  • Experience with real-time serving, ML infrastructure, or GPU orchestration
  • Exposure to platforms like SageMaker, Vertex AI, or Azure ML
  • Contributions to OSS projects like MLflow, PyTorch, Ray, vLLM, SGLang
  • Built developer platforms or internal tools supporting AI workflows

Skills

ScalaGoPythonDistributed SystemsScalable ApisCloud-Native InfrastructureService-Oriented ArchitectureMLflowPyTorchRay

Similar roles

Backend Engineering jobs
Checkr

Staff Software Engineer

CheckrDenver, CO +1

Staff Engineer driving technical architecture across screening product teams. Owns complex multi-system workflows, sets technical standards, mentors engineers, and ships scalable features in a regulated domain.

190k – 264k/yr
Hybrid10+ YOEBackend Engineering
Pinecone

Senior/Staff Software Engineer, Database Team

PineconeNew York, NY

Build and optimize distributed database features for AI applications in Rust, Go, or C++. Focus on performance, reliability, and scalability in a hybrid New York City role.

190k – 270k/yr
Hybrid5+ YOEBackend Engineering
Creditgenie

Staff Software Engineer, Backend

CreditgenieNew York, NY +3

Designs, builds, and scales high-performance backend systems for fintech products, owning architecture to deployment. Leads technical decisions and collaborates cross-functionally, requiring 8+ years in distributed systems and security expertise.

190k – 250k/yr
On-site8+ YOEBackend Engineering
Databricks

Staff Software Engineer, Metrics and Logging

DatabricksMountain View, CA

Designs and scales next-generation logging platform processing petabytes of logs daily for observability across Databricks services. Requires 7+ years experience in Scala/Rust/Go/etc., distributed systems, and BS in Computer Science.

190k – 261k/yr
On-site7+ YOEBackend Engineering
OpenSea

Staff Backend Engineer

OpenSeaUnited States

Staff Backend Engineer leads technical vision and builds scalable, event-driven marketplace infrastructure handling massive transaction volumes, including blockchain indexing, order systems, and APIs. Requires 6+ years experience with JVM languages, Kafka/Flink, and distributed systems.

190k – 345k/yr
Remote6+ YOEBackend Engineering