Build scalable backend infrastructure and products for Databricks' data and AI platform, focusing on resource management, distributed systems, and machine learning. Requires 5+ years experience with Java/Scala/C++, large-scale systems, and cloud technologies.
166k – 225k/yr
On-site5+ YOEBackend Engineering
About the role
Impact You'll Have
Resource management infrastructure powering big data and machine learning workloads in a scalable, secure, and cloud-agnostic way
Develop reliable, scalable services and client libraries that work with massive amounts of data on the cloud, across geographic regions and Cloud providers
Build tools to allow Databricks engineers to operate their services across different clouds and environments
Build services, products and infrastructure at the intersection of machine learning and distributed systems
What We Look For
BS (or higher) in Computer Science, or a related field
5+ years of production level experience in one of: Java, Scala, C++, or similar language
Experience developing large-scale distributed systems
Experience working on a SaaS platform or with Service-Oriented Architectures
Experience with cloud technologies, e.g. AWS, Azure, GCP, Docker, or Kubernetes
Experience with security and systems that handle sensitive data
Good knowledge of SQL
Benefits
Comprehensive health coverage including medical, dental, and vision
Designs and automates networking infrastructure for large-scale Databricks compute clusters across cloud providers. Requires 5+ years in Python/Java/Scala/C++ and 4+ years in distributed systems with networking expertise.
Build AI/ML environment infrastructure enabling researchers to configure training and serving setups reliably. Requires 5+ years backend experience, strong Python/Scala/Java skills, and expertise in distributed systems and containerization.
Designs and implements advanced query engines and storage systems for Lakehouse architecture, focusing on performance optimization across ETL, BI, and ML workloads. Requires 5+ years in database/distributed systems.
Designs and implements advanced query engines and storage systems for Lakehouse architecture, focusing on performance optimization across ETL, BI, and ML workloads. Requires 5+ years in database/distributed systems.
166k – 225k/yr
On-site5+ YOEBackend Engineering
Senior Software Engineer, Storage
CrusoeSan Francisco, CA +1
Designs, builds, and optimizes distributed cloud storage systems for AI/HPC workloads, focusing on high-performance filesystems, block/object storage, and Linux subsystems. Requires deep expertise in scalable storage infrastructure and languages like Go, C++, Rust.