Staff Software Engineer - Distributed Data Systems
Build distributed data storage and processing systems at Databricks, including Apache Spark, Delta Lake, and performance engines. Requires 8+ years in Java/Scala/C++, expertise in distributed systems, databases, and big data technologies.
About the job
Responsibilities
- Build next generation distributed data storage and processing systems that outperform SQL query engines while supporting diverse workloads (ETL, data science).
- Example projects: Apache Spark (big data framework), Data Plane Storage (cloud storage services for AWS S3, Azure Blob Store), Delta Lake (storage with ACID transactions, time travel), Delta Pipelines (orchestrate thousands of data pipelines), Performance Engineering (query optimizer and execution engine).
Requirements
- BS (or higher) in Computer Science or related field, or equivalent experience.
- 8+ years production experience in Java, Scala, or C++.
- Strong foundation in algorithms, data structures, and distributed systems/databases/big data systems (Apache Spark, Hadoop).
- Comfortable with multi-year vision and incremental deliverables.
- Motivated by customer value and impact.
Skills
Java, Scala, C++, Spark, Delta Lake, Aws S3, Azure Blob Storage, Algorithms, Data Structures, Distributed Systems
Similar jobs
Backend Engineering jobs
ezCater
United States
Staff engineer responsible for architecture and delivery of a high-volume finance technology platform covering payments, payouts, invoicing, and taxes. The role requires 8+ years of backend experience, deep payment systems expertise, strong Go skills, and technical leadership across teams.
Motive
San Francisco, CA
Build and evolve scalable platform services, APIs, and product capabilities while making architecture decisions and improving reliability and operational excellence. The role requires substantial software engineering experience, distributed-systems expertise, strong technical judgment, and the ability to mentor engineers.
Haus
Seattle, WAStaff Backend Engineer building distributed data-platform services, ingestion workflows, APIs, and validation pipelines that automate customer data onboarding. Requires 4+ years of backend experience, with strong Python, SQL/dbt, orchestration, cloud warehouse, and infrastructure skills.
tastytrade
Chicago, IL
Staff engineer responsible for designing and operating backend systems for order handling, ledgers, and settlement in a retail brokerage environment. Requires 10+ years of software engineering experience, deep distributed-systems expertise, and strong technical leadership and communication skills.
Attentive
United States
Provides hands-on technical leadership for high-scale backend systems that ingest, process, store, and serve user-profile data. The role requires 8+ years of software engineering experience, distributed-systems expertise, and strong architectural and cross-team leadership.