Skip to content
DatabricksDatabricksMountain View, CA

Senior Software Engineer - Distributed Data Systems

Develop distributed data systems including Apache Spark and Delta Lake to handle big data workloads efficiently. Requires 5+ years in Java/Scala/C++ and expertise in distributed systems.

166k – 225k
On-site5+ YOEData Engineering

About the role

Responsibilities

  • Develop Apache Spark, the open source standard for big data.
  • Build reliable, high-performance storage services for cloud backends (AWS S3, Azure Blob Store).
  • Implement Delta Lake for ACID transactions, time travel, and data lake efficiency.
  • Create Delta Pipelines for orchestrating thousands of data pipelines.
  • Engineer query optimizers and execution engines for speed and scalability.

Requirements

  • BS (or higher) in Computer Science or equivalent.
  • 5+ years production experience in Java, Scala, or C++.
  • Strong foundation in algorithms, data structures, and distributed systems.
  • Experience with databases and big data systems (Apache Spark, Hadoop).

Skills

SparkJavaScalaC++Distributed SystemsDelta LakeAws S3Azure Blob StoreAlgorithmsData Structures
Justworks

Manager, Analytics Engineering

JustworksNew York, NY

Lead and develop a team of analytics engineers to design, build, and maintain scalable data models, ELT pipelines, and BI solutions using modern data stack tools. Requires 7+ years data experience including 2+ years managing teams, deep expertise in SQL, Python, Snowflake, dbt, and dimensional modeling.

166k – 214k
Hybrid7+ YOEData Engineering
Pilot.com

Senior Analytics Engineer

Pilot.comSan Francisco, CA

Owns the data warehouse, semantic layer, and ingestion pipelines using Snowflake, dbt, and Looker. Architects reliable data models, integrates new sources, enables AI workflows, and sets company-wide metrics standards. Requires 5+ years in analytics/data engineering with strong SQL, dbt, and Python.

166k – 224k
On-site5+ YOEData Engineering
Databricks

Senior Software Engineer - Distributed Data Systems

DatabricksSan Francisco, CA

Senior engineer building distributed data systems like Apache Spark and Delta Lake to handle big data processing, ETL, and data science workloads. Requires 5+ years in Java/Scala/C++ and expertise in distributed systems.

166k – 225k
On-site5+ YOEData Engineering
Jellyfish

Senior Software Engineer, Data Products

JellyfishUnited States

Senior engineer building performant user-facing data products from internal datasets using Python, Databricks, and Postgres while collaborating with platform teams.

165k – 235k
Remote5+ YOEData Engineering
Raylu

Senior Data Engineer

RayluNew York, NY

Designs and runs massive-scale data pipelines for ingestion, normalization, enrichment, and delivery across 80M+ companies and 800M+ people. Manages data operations, BPO vendors, partnerships, monitoring, and cost optimization using Python, Dagster, and DuckDB.

165k – 250k
On-siteData Engineering