Designs and implements advanced query engines and storage systems for Lakehouse architecture, focusing on performance optimization across ETL, BI, and ML workloads. Requires 5+ years in database/distributed systems.
166k – 225k/yr
On-site5+ YOEBackend Engineering
About the role
Responsibilities
Query compilation and optimization
Distributed query execution and scheduling
Vectorized execution engine
Data security
Resource management
Transaction coordination
Efficient storage structures (encodings, indexes)
Automatic physical data optimization
Requirements
Passion for database systems, storage systems, distributed systems, language design, or performance optimization
Experience working toward multi-year visions with incremental deliverables
Motivated by customer value and impact
5+ years of experience in related systems (preferred)
Designs and automates networking infrastructure for large-scale Databricks compute clusters across cloud providers. Requires 5+ years in Python/Java/Scala/C++ and 4+ years in distributed systems with networking expertise.
Build AI/ML environment infrastructure enabling researchers to configure training and serving setups reliably. Requires 5+ years backend experience, strong Python/Scala/Java skills, and expertise in distributed systems and containerization.
Designs and implements advanced query engines and storage systems for Lakehouse architecture, focusing on performance optimization across ETL, BI, and ML workloads. Requires 5+ years in database/distributed systems.
166k – 225k/yr
On-site5+ YOEBackend Engineering
Senior Software Engineer - Backend
DatabricksSan Francisco, CA +1
Build scalable backend infrastructure and products for Databricks' data and AI platform, focusing on resource management, distributed systems, and machine learning. Requires 5+ years experience with Java/Scala/C++, large-scale systems, and cloud technologies.
166k – 225k/yr
On-site5+ YOEBackend Engineering
Senior Software Engineer, Storage
CrusoeSan Francisco, CA +1
Designs, builds, and optimizes distributed cloud storage systems for AI/HPC workloads, focusing on high-performance filesystems, block/object storage, and Linux subsystems. Requires deep expertise in scalable storage infrastructure and languages like Go, C++, Rust.