Sr. Data Engineer
Build and maintain scalable data pipelines and platforms that enable AI applications to securely access trusted data. Partner with analytics, marketing, and product teams to deliver production-grade data systems.
Senior Software Engineer, Data Engineering
Builds and scales ETL pipelines, designs data schemas, and owns data quality/governance for 10x growth. Requires 5+ years in data pipelines with SQL, Spark, Airflow, Python, and MPP databases like Snowflake/Redshift.
164k – 227kSan Francisco, CAData EngineeringHybrid5+ YOE
About the role
Responsibilities
- Be a hands-on data engineer, building, scaling and optimizing ETL pipelines
- Design data schemas and scale them for 10x data growth
- Ownership of all aspects of data - data quality, data governance, schema design, data quality and security
- Develop scalable data architecture and standardized data models that enable self-serve data insights using AI
- Own the ETL workflows and make sure the pipeline meets data quality and availability requirements
- Work closely with partner teams, like Data Science, Analytics and DevOps
Requirements
- 5+ years experience transforming data to governed and lucid datasets
- 5+ years of hands-on experience to build and deploy production-quality data pipelines
- 5+ years of experience working with stakeholders to provide business insights
- 5+ years of experience writing SQL, Spark, AWS Glue, EMR, Airflow, Python
- 3+ years of hands-on experience using any MPP database system like Snowflake, AWS Redshift or Teradata
- Track record of successful partnerships with Analytics, Data Science and DevOps teams
- Understanding of key metrics for data pipelines and has built solutions to provide visibility to partner teams
Note: Engineers are required to participate in on-call rotation.
Compensation
Base salary: $164,000 - $227,000, plus bonus, equity, and benefits.
Skills
SQLSparkAws GlueEmrAirflowPythonSnowflakeAws RedshiftTeradataETL
Similar roles
Data Engineering jobsSenior Software Engineer, Data Products
Senior engineer building performant user-facing data products from internal datasets using Python, Databricks, and Postgres while collaborating with platform teams.
Senior Data Engineer
Designs and runs massive-scale data pipelines for ingestion, normalization, enrichment, and delivery across 80M+ companies and 800M+ people. Manages data operations, BPO vendors, partnerships, monitoring, and cost optimization using Python, Dagster, and DuckDB.
Senior Software Engineer, Data Governance & Foundations
Instacart is seeking a Senior Software Engineer for the Data Governance & Foundations team. This role involves defining and driving architecture roadmaps for large-scale data ingestion and processing infrastructure, owning end-to-end platform initiatives, and optimizing infrastructure spend.
Senior Analytics Engineer
Owns the data warehouse, semantic layer, and ingestion pipelines using Snowflake, dbt, and Looker. Architects reliable data models, integrates new sources, enables AI workflows, and sets company-wide metrics standards. Requires 5+ years in analytics/data engineering with strong SQL, dbt, and Python.