Staff Data Platform Engineer
Staff Data Platform Engineer building and leading AWS-native data platform architecture, orchestration, governance, and AI-readiness for analytics and ML workloads. Requires 8-10+ years experience with AWS data systems and strong technical leadership.
About the job
Build and Evolve Our AWS-Native Data Platform
- Lead the architecture and development of scalable, secure, and cost-efficient data platforms on AWS.
- Architect and optimize our Data Warehouse to support growing analytical, operational, and AI-driven workloads.
- Define and implement Infrastructure-as-Code standards using AWS CDK.
Own Data Orchestration and Data Engineering Foundations
- Design and operate scalable orchestration frameworks using Airflow and Fivetran.
- Partner with the Data Analytics team to establish data modeling standards and transformation practices using dbt.
- Build reusable, maintainable data pipelines and workflows that enable rapid development and reliable operation.
Enable Trusted Data Access Through Governance and AI Readiness
- Establish governance, metadata, lineage, and access patterns that make data discoverable, trustworthy, and easy to use.
- Help define how both employees and AI-powered systems safely access and leverage company data.
- Build the foundations that enable self-service analytics and future agentic workflows across the organization.
Drive Reliability, Observability, and Operational Excellence
- Establish monitoring, alerting, and observability standards using Datadog and modern platform engineering practices.
- Build scalable data quality frameworks that ensure confidence in business-critical data.
- Continuously improve platform reliability, performance, and cloud cost efficiency.
Lead Through Technical Influence and Partnership
- Partner closely with Data Science, Analytics, Product, and Engineering teams to solve complex business problems through data.
- Provide technical leadership, architectural guidance, and mentorship across the data organization.
- Influence long-term platform strategy and engineering best practices across multiple teams.
What We're Looking For
- 8–10+ years of experience building and operating large-scale data platforms, pipelines, and warehouses in cloud environments, with deep expertise in AWS.
- Proven track record leading complex technical initiatives and influencing architecture across teams.
- Strong software engineering fundamentals and experience building production-grade systems.
- Deep expertise in modern data warehousing, ELT/ETL architectures, and data platform design.
- Experience operating data platforms with a focus on reliability, observability, data quality, and cost optimization.
- Proven ability to leverage modern AI-assisted and agentic development tools to architect, build, and operate production-grade systems.
- Experience partnering with data scientists, analysts, product managers, and software engineers to deliver business impact.
- Demonstrated ability to navigate ambiguity, drive alignment, and lead through influence rather than authority.
- Passion for building platforms that empower others and scale organizational impact.
Preferred Qualifications
- Strong hands-on experience with Python, Amazon Redshift, AWS-native ETL technologies (including ZeroETL and DMS), Airflow, dbt, Datadog, Fivetran, and AWS CDK.
- Experience designing data governance, metadata, lineage, or self-service data platforms.
- Experience supporting AI, machine learning, or agentic workflow initiatives.
- Experience leading platform modernization efforts in high-growth environments.
- Experience as a Staff Engineer, Principal Engineer, Technical Lead, or Engineering Manager.
Skills
Python, Amazon Redshift, Aws Cdk, Airflow, dbt, Datadog, Fivetran, Aws Dms, Zeroetl, Data Governance
Similar jobs
Data Engineering jobsLeads large-scale advertising data ingestion, measurement, and agentic workflow systems, combining deep ad-tech expertise with production LLM experience. Requires 10+ years of engineering experience and technical and people leadership in complex enterprise environments.
Build and scale data ingestion platforms, pipelines, APIs, and processing products that move billions of rows across a multi-tenant system. The role requires 8+ years of software development experience and strong expertise in large-scale application architecture.
Staff Data Engineer leading data platform initiatives across batch, streaming, real-time pipelines, data lake infrastructure, governance, and privacy. Requires 5+ years of data engineering experience, strong Spark and distributed processing expertise, and the ability to lead complex production systems.
Staff Software Engineer leading design and development of large-scale batch and real-time data pipelines and ML infrastructure to power GenAI/LLM products and features for Airbnb's Messaging, Notifications, and Connectivity organization. Requires 9+ years experience building production ML systems and cross-functional collaboration.
This staff-level data engineer will architect and operate low-latency market data infrastructure, including feed handling, normalization, distribution, and exchange connectivity. The role requires at least five years of backend engineering experience and strong Java or C++ expertise with high-throughput messaging and market data protocols.