Senior Data Engineer

Responsibilities

• Design, build, and own large-scale data pipelines that transform high-volume raw data into curated, production-grade datasets for reporting and measurement products.
• Take data products from requirements through tech spec, implementation, validation, and production rollout.
• Partner closely with data science on methodology, backend and frontend engineers on serving layers, and product on requirements.

Requirements

• 5+ years of dedicated experience designing, building, and operating production ETL pipelines at scale.
• Strong programming skills in Python (or similar) and SQL.
• Deep hands-on experience with Spark/PySpark, Databricks, and Delta Lake.
• Experience with workflow orchestration tools such as Airflow, including DAG design, backfills, and failure recovery.
• Strong data modeling skills for analytics, including curated/gold-layer datasets, schema design, partitioning, and data contracts for downstream services.
• Rigorous approach to data quality: validation, reconciliation, and methodology comparison.
• Experience debugging distributed data systems, including performance tuning, memory issues, and optimizations.
• Strong written communication and cross-functional collaboration skills.

Nice-to-Haves

• Ongoing interest in agentic developer workflows: testing agent harnesses, building them, agent loop engineering, and similar emerging paradigms.
• Experience with OLAP stores (e.g., ClickHouse).

Compensation and Benefits

• Total compensation: $170,000 - $200,000 annually.
• Equity compensation.
• Health insurance coverage for you and your dependents.
• 401K, FSA, and commuter benefits.
• $150 monthly spending account.
• $1,000 annual continued education benefit.
• $500 Newbie Productivity Perk.
• Unlimited PTO and sick days.
• Monthly Company Wellness Day Off.
• Snacks, drinks, and catered lunches at the office.
• Team building events.
• Hybrid RTO of 2 days per week in office.