Senior Data Engineer
Builds and scales reliable data pipelines and infrastructure using AWS and tools like Spark, Kafka, and dbt. Collaborates with teams to deliver data solutions, mentors engineers, and drives data architecture strategy. Requires 6+ years experience.
About the job
Responsibilities
- Design and build a platform that is reliable, observable, and scalable.
- Drive the strategy behind our data architecture and tooling.
- Collaborate across the company with product, reporting, and platform teams to deliver the right data at the right time.
- Level up the organization by mentoring other engineers, establishing best practices, and contributing to a high-trust culture.
- Deliver incremental improvements, especially when things feel ambiguous or messy.
- Stay adaptable and flexible.
Requirements
- 6+ years of experience in data engineering or adjacent backend roles.
- Proven success building and scaling data pipelines, platform, and infrastructure.
- Deep knowledge of AWS and open-source data tools (e.g. Spark, Iceberg, Kafka, dbt, etc.).
- Comfortable balancing speed and quality: know when to build a prototype and when to build for scale.
- Excellent communication: drive communication and prioritization with other internal teams to determine their data tooling needs.
- Technical mentorship: help set the vision, explain technical decisions clearly, and bring others along.
Nice to Haves
- Proficiency in Python, SQL, and infrastructure-as-code (Terraform preferred).
- Prior experience working in a regulated environment (e.g., healthcare, finance).
Perks & Benefits
- Comprehensive Health Coverage: Medical, dental, and vision plans with nationwide coverage, including 24/7 virtual urgent care.
- Mental Health Support: Weekly therapy reimbursement up to $100.
- Paid Parental Leave: Up to 12 weeks of fully paid time off for new parents.
- Financial Wellness: 401K (traditional & Roth), HSA & FSA options, and monthly commuter benefits for NYC employees.
- Time Off That Counts: Flexible PTO.
- Fitness Stipend: $100/month.
- Hybrid Flexibility: In NYC? We work in the office 3–5x/week, with flexibility when life happens. Fridays are remote-friendly.
Skills
AWS, Spark, Iceberg, Kafka, dbt, Python, SQL, Terraform
Similar jobs
Data Engineering jobs
Creditgenie
Plymouth Meeting, PASenior Data Engineer responsible for designing and operating scalable data pipelines and platform capabilities across Snowflake and AWS. The role requires 5+ years of production data engineering experience, strong SQL and Python skills, and expertise in ETL/ELT, orchestration, quality, and observability.
Machinify
United States
Build and scale production data pipelines that transform raw healthcare and customer data into trusted canonical datasets powering ML models, dashboards, and product decisions. The role requires 6+ years of data engineering experience and strong Python, Spark SQL, and Airflow expertise.
Fetch
United States
Senior software engineer building and evolving Fetch’s data platform, including pipelines, governed data access, delivery infrastructure, and partner integrations. The role requires 8+ years of experience, strong platform or backend expertise, ownership of complex cross-team initiatives, and excellent technical judgment.
Thyme Care
Remote
The Senior Platform Engineer will build and operate reliable data platform tooling, consolidate orchestration, scale dbt infrastructure, and improve Databricks developer experience. The role requires 5+ years of production software experience, strong Python and AWS expertise, infrastructure-as-code experience, and familiarity with modern data stacks.
Runpod
San Francisco, CA
The Senior Data Engineer will design scalable data pipelines and warehousing systems supporting analytics, business metrics, and machine-learning initiatives. The role requires 4+ years of enterprise data experience, expertise with modern data platforms and ETL, and the ability to mentor engineers and collaborate across functions.