# Staff Software Engineer, Lakeflow Pipelines DR

**Company:** [Databricks](https://hotfix.jobs/companies/databricks)
**Location:** Mountain View, CA, San Francisco, CA
**Role:** Data Engineering
**Salary:** $192k – $260k/yr
**Experience:** 8+ years
**Skills:** Java, Scala, C++, Go, Python, Distributed Systems, Databases, Storage Systems, Streaming Systems, Reliability Engineering, Transactions, Replication, Checkpointing, Data Lineage
**Posted:** 2026-09-11

> Staff engineer designing distributed systems for cross-region replication, failover, and recovery of Lakeflow data pipelines. The role requires strong production software engineering skills and expertise in consistency, transactions, idempotency, replication, and related systems, with 8+ years of experience preferred.

## Job Description

## Responsibilities
- Design and implement distributed systems that replicate and recover Lakeflow pipelines across regions.
- Build cross-region replication and recovery for pipelines, streaming tables, and materialized views.
- Develop consistency mechanisms across pipeline dependencies, table versions, and transaction logs.
- Implement failover and failback workflows with conservative correctness guardrails.
- Build deep clone, metadata reconciliation, observability, and failure-injection testing capabilities.
- Develop high-fidelity recovery simulations and game-day testing.
- Apply formal reasoning to failure modes and deliver incremental, production-quality systems toward a multi-year technical vision.

## Requirements
- Strong software engineering skills in Java, Scala, C++, Go, Python, or a similar production language.
- Understanding of consistency, transactions, idempotency, replication, checkpointing, and data lineage.
- Passion for distributed systems, databases, storage systems, streaming systems, or reliability engineering.
- 8+ years of experience working on related systems preferred.

## Nice to Have
- PhD or advanced research experience in databases, distributed systems, or storage.

## Compensation
- Local pay range: $192,000–$260,000 USD.
- May include annual performance bonus, equity, and benefits.

## Similar jobs

- [Staff Software Engineer, Ads Measurement & Orchestration](https://hotfix.jobs/jobs/a8a95b11-6cd7-494a-beff-d80cc0f57bd5) - Databricks - New York, NY - $191k – $254k/yr
- [Staff Software Engineer - Data Ingestion](https://hotfix.jobs/jobs/62fa6d21-7c46-4442-8aed-31e5566c3c54) - Rippling - San Francisco, CA - $189k – $315k/yr
- [Staff Data Engineer](https://hotfix.jobs/jobs/cbf1336e-4f97-4eb9-9dde-e148d6ddfaa2) - Webflow - Remote - $187k – $255k/yr
- [Staff Software Engineer, Data](https://hotfix.jobs/jobs/94ded909-e12c-4870-a6d1-9c61b78cfa35) - IntusCare - Remote - $180k – $190k/yr
- [Staff Analytics Engineer](https://hotfix.jobs/jobs/81ff0bfd-e953-41b3-8c4d-44e1c8f9b376) - Rula - Remote - $180k – $221k/yr

**Apply:** https://hotfix.jobs/jobs/2c436633-6e3c-4617-82d7-6f18e89cb8b4
**Canonical:** https://hotfix.jobs/jobs/2c436633-6e3c-4617-82d7-6f18e89cb8b4