Senior Data Engineer
Senior Data Engineer responsible for designing and operating scalable data pipelines and platform capabilities across Snowflake and AWS. The role requires 5+ years of production data engineering experience, strong SQL and Python skills, and expertise in ETL/ELT, orchestration, quality, and observability.
About the job
Responsibilities
- Design, develop, and operate reliable batch, streaming, and change data capture (CDC) pipelines for first-party and third-party data.
- Lead the technical design of ETL/ELT and orchestration workflows, balancing performance, scalability, maintainability, and cost.
- Develop maintainable SQL and Python solutions for transformation, validation, automation, and complex data processing.
- Design data quality, freshness monitoring, alerting, and observability capabilities.
- Optimize Snowflake workloads, storage, and pipeline architecture for reliability, performance, scalability, and cost efficiency.
- Investigate production data incidents, identify root causes, and implement durable fixes.
- Partner with Analytics Engineering, Data Science, Product, Engineering, and other stakeholders on data contracts and data products.
- Establish engineering standards for testing, version control, CI/CD, documentation, schema design, and pipeline development.
- Provide technical guidance and code review to other engineers.
Requirements
- 5+ years of data engineering or closely related experience designing, building, and operating production data systems.
- Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
- Advanced SQL skills and strong proficiency in Python or a similar programming language.
- Strong experience with Snowflake and AWS, including performance, reliability, and cost considerations.
- Deep experience with ETL/ELT, orchestration, schema design, and data modeling using dbt, Airflow, or similar technologies.
- Strong understanding of batch and real-time data architectures, including streaming and CDC technologies.
- Experience designing data quality controls, testing frameworks, monitoring, observability, and production support practices.
- Working knowledge of Git-based development, CI/CD, automated testing, and modern software engineering practices.
- Ability to independently solve complex technical problems, exercise sound judgment, and communicate recommendations to technical and business stakeholders.
Compensation and Benefits
- Base salary: $180,000–$210,000 annually.
- Potential eligibility for bonus and equity programs.
- Company-paid medical, dental, and vision coverage for employees and dependents from the first day.
- Up to $100 per month in fitness reimbursement or complimentary LifeTime Fitness or Equinox membership.
- 401(k) with a 3.5% match and immediate vesting.
- Meal program for lunch and dinner.
- Pre-tax benefits, including a $1,000 HSA match.
- Life and accidental insurance.
- Flexible PTO.
Skills
SQL, Python, Snowflake, AWS, ETL, ELT, dbt, Airflow, Data Modeling, Streaming, Change Data Capture, Git, CI/CD, Data Quality, Observability
Similar jobs
Data Engineering jobs
Machinify
United States
Build and scale production data pipelines that transform raw healthcare and customer data into trusted canonical datasets powering ML models, dashboards, and product decisions. The role requires 6+ years of data engineering experience and strong Python, Spark SQL, and Airflow expertise.
Fetch
United States
Senior software engineer building and evolving Fetch’s data platform, including pipelines, governed data access, delivery infrastructure, and partner integrations. The role requires 8+ years of experience, strong platform or backend expertise, ownership of complex cross-team initiatives, and excellent technical judgment.
Thyme Care
Remote
The Senior Platform Engineer will build and operate reliable data platform tooling, consolidate orchestration, scale dbt infrastructure, and improve Databricks developer experience. The role requires 5+ years of production software experience, strong Python and AWS expertise, infrastructure-as-code experience, and familiarity with modern data stacks.
Runpod
San Francisco, CA
The Senior Data Engineer will design scalable data pipelines and warehousing systems supporting analytics, business metrics, and machine-learning initiatives. The role requires 4+ years of enterprise data experience, expertise with modern data platforms and ETL, and the ability to mentor engineers and collaborate across functions.
Otter
Mountain View, CA
Build and own foundational data models, reliable pipelines, and data platforms that support analytics and business decision-making. The role requires 5+ years of data engineering experience, strong Python and SQL skills, cloud data warehouse expertise, and a bachelor's degree or equivalent experience.