Data Engineer, Notifications
Builds and owns scalable data pipelines and models for Whatnot's high-volume notifications platform, supporting ML, analytics, and product teams. Requires 5+ years experience with SQL/Python, modern data tools, and cloud warehouses.
Responsibilities
- Own data architecture end-to-end: define capture, modeling, and serving of critical business data; implement in production with decisions on storage, compute, and SLAs.
- Build mission-critical pipelines: develop and operate batch workflows for high-volume notification events with guarantees on latency, completeness, and accuracy.
- Design and implement canonical models: create domain-oriented data models as source of truth for analytics, ML, and applications; enforce standards, ownership, and contracts.
- Enforce data quality at scale: build tests, lineage, monitoring, and reconciliation systems.
- Automate operational workflows: partner to eliminate manual handoffs and reconcile data across services and warehouses.
- Enable insights and experimentation: support analytics, ML, and product teams with high-quality data assets.
Requirements
- 5+ years experience in data or software engineering.
- Strong experience building production-grade data pipelines with SLAs, monitoring, alerting.
- Deep expertise in SQL (complex models, dependencies, optimization).
- Production-grade code in Python or SQL, CI/CD, infrastructure-as-code.
- Hands-on with ingestion (Kafka, Debezium), transformation (dbt, Spark, Flink), orchestration (Dagster, Airflow), observability (Monte Carlo, Great Expectations).
- Operated cloud data warehouses (Snowflake, BigQuery, Redshift): schema design, cost optimization, tuning.
- Proven with large-scale datasets (hundreds of millions rows/day).
- Data models balancing analytics, ML, operational use cases.
- Strong systems thinking (correctness, latency, cost, maintainability).
- Self-starter, autonomous, exceptional communication.
Staff Data Platform Engineer
Staff Data Platform Engineer building and leading AWS-native data platform architecture, orchestration, governance, and AI-readiness for analytics and ML workloads. Requires 8-10+ years experience with AWS data systems and strong technical leadership.
Manager, Data Engineering
Lead and mentor a team of data engineers building scalable data pipelines and platform infrastructure. Hands-on coding, operational excellence, and cross-functional collaboration with analytics, data science, and business teams.
Senior Data Engineer, People Analytics
Build and maintain data pipelines, tables, and AI-ready data foundations from HR systems to power People Analytics reporting, dashboards, and LLM tools. Requires 5+ years of data engineering experience with strong SQL, Python, Airflow, and data governance skills.