Skip to content
RayluRayluNew York, NY

Senior Data Engineer

Designs and runs massive-scale data pipelines for ingestion, normalization, enrichment, and delivery across 80M+ companies and 800M+ people. Manages data operations, BPO vendors, partnerships, monitoring, and cost optimization using Python, Dagster, and DuckDB.

165k – 250k
On-siteData Engineering

About the role

Responsibilities

  • Own end-to-end data flows: ingestion, normalization, entity resolution, enrichment, and delivery.
  • Stand up monitoring for freshness, completeness, and accuracy; drive RCA and prevention.
  • Build internal tools that make data discoverable and usable by engineering and product.
  • Recruit, onboard, and manage BPO vendors; negotiate and run data partnerships.

Core Requirements

  • Core stack: Python, Dagster, DuckDB
  • Pipelines at scale: Building resilient ELT/ETL with strong contracts, idempotency, and lineage.
  • Data operations: Set quality bars, manage BPO workflows, and run SLAs with external data partners.
  • Serving & access: Position data for production use from serving infrastructure, documentation, and SLAs for internal consumers.
  • Cost & performance: Tune storage/compute and keep a sharp eye on unit economics.
  • Opinionated: Deep level of understanding of the technological landscape, making both high level system and granular code design decisions based on understanding rather than preference - diving deep on unknown patterns in order to build the best product.

Nice to Have

  • Experience with big data, columnar storage formats, vector indexes, and privacy/compliance in data products.

Compensation

  • Salary: $165K - $250K
  • Equity: $100K-200K equivalent (4 year vest)

Skills

PythonDagsterDuckdbELTETLEntity ResolutionData PipelinesData MonitoringColumnar StorageVector Indexes

Similar roles

Data Engineering jobs
Jellyfish

Senior Software Engineer, Data Products

JellyfishUnited States

Senior engineer building performant user-facing data products from internal datasets using Python, Databricks, and Postgres while collaborating with platform teams.

165k – 235k
Remote5+ YOEData Engineering
Justworks

Manager, Analytics Engineering

JustworksNew York, NY

Lead and develop a team of analytics engineers to design, build, and maintain scalable data models, ELT pipelines, and BI solutions using modern data stack tools. Requires 7+ years data experience including 2+ years managing teams, deep expertise in SQL, Python, Snowflake, dbt, and dimensional modeling.

166k – 214k
Hybrid7+ YOEData Engineering
Pilot.com

Senior Analytics Engineer

Pilot.comSan Francisco, CA

Owns the data warehouse, semantic layer, and ingestion pipelines using Snowflake, dbt, and Looker. Architects reliable data models, integrates new sources, enables AI workflows, and sets company-wide metrics standards. Requires 5+ years in analytics/data engineering with strong SQL, dbt, and Python.

166k – 224k
On-site5+ YOEData Engineering
Chime

Senior Software Engineer, Data Engineering

ChimeSan Francisco, CA

Builds and scales ETL pipelines, designs data schemas, and owns data quality/governance for 10x growth. Requires 5+ years in data pipelines with SQL, Spark, Airflow, Python, and MPP databases like Snowflake/Redshift.

164k – 227k
Hybrid5+ YOEData Engineering
Databricks

Senior Software Engineer - Distributed Data Systems

DatabricksMountain View, CA

Develop distributed data systems including Apache Spark and Delta Lake to handle big data workloads efficiently. Requires 5+ years in Java/Scala/C++ and expertise in distributed systems.

166k – 225k
On-site5+ YOEData Engineering