Build AI/ML environment infrastructure enabling researchers to configure training and serving setups reliably. Requires 5+ years backend experience, strong Python/Scala/Java skills, and expertise in distributed systems and containerization.
166k – 220k/yr
On-site5+ YOEBackend Engineering
About the role
The impact you will have
Build the infrastructure that enables ML and AI users to configure training and serving environments easily, reliably and reproducibly.
Collaborate with other AI infrastructure teams to build the features that customers need to get more from the Databricks platform. Examples include improving performance of setting up virtual environments for short training and data processing sessions, improving observability to help customers debug when runs fail, etc.
Interact with turnkey customers and product managers to envision new features and identify areas for improvement.
Shape how developers and data scientists build and interact with AI on Databricks.
What we look for
5+ years of experience in backend or infrastructure engineering with a focus on building systems
Strong programming skills in Python, Scala or Java
Experience with distributed systems, scalable APIs, or cloud-native infrastructure
Familiarity with service-oriented architecture, deployment pipelines, and system observability
Strong product and ownership mindset — you care about building the right solution, not just any solution
Strong understanding of dependency management technologies including virtual environments or containerization technologies.
Designs and automates networking infrastructure for large-scale Databricks compute clusters across cloud providers. Requires 5+ years in Python/Java/Scala/C++ and 4+ years in distributed systems with networking expertise.
166k – 225k/yr
On-site5+ YOEBackend Engineering
Senior Software Engineer - Backend
DatabricksSan Francisco, CA +1
Build scalable backend infrastructure and products for Databricks' data and AI platform, focusing on resource management, distributed systems, and machine learning. Requires 5+ years experience with Java/Scala/C++, large-scale systems, and cloud technologies.
Designs and implements advanced query engines and storage systems for Lakehouse architecture, focusing on performance optimization across ETL, BI, and ML workloads. Requires 5+ years in database/distributed systems.
Designs and implements advanced query engines and storage systems for Lakehouse architecture, focusing on performance optimization across ETL, BI, and ML workloads. Requires 5+ years in database/distributed systems.
166k – 225k/yr
On-site5+ YOEBackend Engineering
Senior Software Engineer, Storage
CrusoeSan Francisco, CA +1
Designs, builds, and optimizes distributed cloud storage systems for AI/HPC workloads, focusing on high-performance filesystems, block/object storage, and Linux subsystems. Requires deep expertise in scalable storage infrastructure and languages like Go, C++, Rust.