Skip to content
Databricks

Senior Software Engineer - Distributed Data Systems

158k – 214kBellevue, WAOnsite5+ YOE
Summary

Build distributed data storage and processing systems for big data workloads including Apache Spark, Delta Lake, and performance optimization. Requires 5+ years in Java/Scala/C++, strong algorithms knowledge, and distributed systems experience.

About the role

Responsibilities

  • Build next generation distributed data storage and processing systems that outperform SQL query engines while supporting ETL, data science, and other workloads.
  • Example projects:
    • Apache Spark™: Develop the open source standard framework for big data.
    • Data Plane Storage: Build reliable, high-performance services and client libraries for cloud storage (AWS S3, Azure Blob Store).
    • Delta Lake: Create storage management system with ACID transactions, time travel, data lake scale, and warehouse performance.
    • Delta Pipelines: Orchestrate and operate tens of thousands of data pipelines with higher-level abstractions.
    • Performance Engineering: Develop fast, scalable query optimizer and execution engine.

Requirements

  • BS (or higher) in Computer Science or related field, or equivalent experience.
  • 5+ years production experience in Java, Scala, or C++.
  • Strong foundation in algorithms, data structures, and real-world applications.
  • Experience with distributed systems, databases, and big data systems (Apache Spark, Hadoop).
  • Comfortable working toward multi-year vision with incremental deliverables.
  • Motivated by customer value and impact.
Skills
JavaScalaC++Apache SparkDelta LakeAWS S3Azure Blob StorageAlgorithmsData StructuresDistributed Systems
Similar roles at this salary range
All Data Engineering jobs →
Loop Financial

Analytics Engineer

Build and own core data models, ETL pipelines, and analytics infrastructure to enable data-driven decisions across the company and clients. Requires 2+ years building analytical products, strong SQL/Python, and modern data stack experience.

135k – 155kChicago, ILData EngineeringOn-siteSQLdbt
Instacart

Senior Data Engineer II, Finance

Senior data engineer building and owning financial data pipelines, models, and ETL/ELT systems for accounting, billing, and revenue reporting at Instacart.

183k – 232kUnited StatesData EngineeringRemoteSQLdbt
Airbnb

Senior Data Engineer, People Analytics

Build and maintain data pipelines, tables, and AI-ready data foundations from HR systems to power People Analytics reporting, dashboards, and LLM tools. Requires 5+ years of data engineering experience with strong SQL, Python, Airflow, and data governance skills.

179k – 210kUnited StatesData EngineeringRemoteSQLAWS
Pinterest

Engineering Manager II, Big Data Storage

Staff-level engineer leading design and development of Pinterest’s exabyte-scale data lake storage platform using Iceberg and related big data technologies to support ML/AI workloads.

177k – 365kPalo Alto, CAData EngineeringHybridJavaTrino
Turquoise Health

Data Science Engineer, Analytics

Build data pipelines, models, dashboards, and analyses to support product and business decision-making. Requires 2+ years of Python/SQL experience with data modeling, ETL tools, and AWS.

145k – 160kSan Diego, CAData EngineeringRemoteSQLdbt
Apply