# Staff Software Engineer, Datalake Platform

**Company:** [Stripe](https://hotfix.jobs/companies/stripe)
**Location:** Dublin, Ireland
**Role:** Data Engineering
**Experience:** 10+ years
**Skills:** Apache Iceberg, Hive Metastore, Spark, Trino, Flink, Pyiceberg, Amazon S3, Azure Blob, IAM, Access Control, Authorization, Distributed Systems, Data Migration, Audit Logging, Lifecycle Management
**Posted:** 2026-08-06

> Leads architecture and operation of a petabyte-scale data lake platform, including Iceberg metastore services, object storage abstractions, migrations, authorization, and compliance controls. Requires 10+ years of software engineering experience and a track record with large-scale distributed storage or data infrastructure.

## Job Description

## Responsibilities

- Architect a unified Apache Iceberg platform, including a metastore service serving as the source of truth for Iceberg table management across Spark, Trino, Flink, and PyIceberg.
- Define API contracts, authorization models, per-table credential vending, and integration patterns for data pipelines.
- Own the migration strategy from Hive Metastore-backed workloads, including sequencing, backward compatibility, rollback, and cross-team coordination.
- Define an object storage abstraction layer covering bucket provisioning, access-control policy design, and developer-facing client libraries.
- Translate regulatory requirements into preventative technical controls, including audit logging, access review infrastructure, data segregation, and lifecycle enforcement.
- Identify inefficiencies in storage layout, snapshot retention, and data lifecycle at petabyte scale; design automated self-service tooling to address them.
- Lead critical design reviews, establish reliability, security, and developer-experience standards, and mentor senior engineers through architectural decisions.

## Requirements

- 10+ years of professional software engineering experience.
- Track record designing, building, and operating large-scale distributed storage or data infrastructure systems.
- Deep experience with object storage such as Amazon S3 or Azure Blob, including IAM, access-control policy design, lifecycle management, and petabyte-scale operations.
- Experience leading complex, multi-quarter infrastructure projects end-to-end, managing cross-team dependencies, and coordinating migrations across many consuming teams.
- Strong background in authorization and access-control design for distributed data systems.

## Nice to Have

- Deep expertise in Apache Iceberg, including table-format internals, the REST Catalog specification, snapshot lifecycle management, compaction, and integration with Spark, Trino, Flink, and PyIceberg.
- Experience with compliance-sensitive infrastructure, including SOX, ICFR, or equivalent regulatory frameworks, and translating audit and access-review requirements into preventative technical controls.
- Experience executing large-scale data migrations with attention to sequencing, blast-radius reduction, rollback, and data-integrity validation.
- Strong developer-experience sensibility, including building ergonomic, well-documented abstractions that reduce engineering toil.

## Similar jobs

- [Staff Software Engineer, Foundations](https://hotfix.jobs/jobs/40a0127d-7f18-472a-9500-51cb34a7b30a) - Vanta - Remote - $260k – $306k/yr
- [Staff Data Engineer - GTM](https://hotfix.jobs/jobs/c70ef762-b7a1-453f-989b-192d5a7291b7) - Intercom - Dublin, Ireland
- [Senior Data Engineer](https://hotfix.jobs/jobs/87b44df0-4459-4294-af40-945c2cbeaa59) - Alpaca - Remote
- [Senior Platform Engineer, Data](https://hotfix.jobs/jobs/e775b0db-178b-4b4f-8b9a-13423115adef) - Thyme Care - Remote - $176k – $195k/yr
- [Senior Data Engineer](https://hotfix.jobs/jobs/cf45e5a5-fb7b-43fb-94e6-dff187027a77) - Vanta - Remote - $190k – $224k/yr

**Apply:** https://hotfix.jobs/jobs/3204eb66-73f9-4952-937f-58c19862b221
**Canonical:** https://hotfix.jobs/jobs/3204eb66-73f9-4952-937f-58c19862b221