Skip to content
Lightning AILightning AINew York, NY

Manager, Data Engineering

Lead data engineering and analytics engineering teams to design and own ETL/ELT pipelines, data modeling, quality, and governance. Requires 10+ years data engineering experience including 4+ years managing teams, deep expertise in SQL/Python/modern data stack, and partnering with DS/Product/Eng.

188k – 275k
Hybrid10+ YOEData Engineering

About the role

What You’ll Do

  • Design and own ETL/ELT pipelines that move GPU telemetry, product usage, operational data, and customer data from where it lives to where it's useful
  • Build and maintain the clean, documented tables that analysts and data scientists actually work from — not raw dumps
  • Own data quality end-to-end: schema management, freshness monitoring, lineage tracking, and alerting when something breaks
  • Partner with engineering and GTM teams to instrument what isn't already tracked
  • Work closely with product, infra, and ML teams, primarily unblocking them

What You’ll Need

  • 4+ years of experience managing analytics engineering or data engineering teams, preferably in a scaling startup environment
  • 10+ years of total experience in analytics engineering, data engineering, or similar data-focused roles
  • Deep expertise in data modeling, ETL pipelines, and data warehouse architecture
  • Strong technical foundation with expertise in SQL, Python, and modern data stack tools (dbt, SQLMesh, etc)
  • Proven track record of building and leading high-performing teams
  • Experience partnering with Data Science, Product, and Engineering leaders to deliver key product metrics and user behavior insights
  • Demonstrated ability to balance strategic thinking with hands-on technical leadership
  • Strong communication skills with the ability to translate complex technical concepts for diverse audiences
  • Experience scaling analytics functions from early stage to maturity in rapidly changing environments
  • Track record of establishing data governance, quality standards, and best practices
  • A bias for action and urgency, not letting perfect be the enemy of the effective
  • A “full-stack mindset”, not hesitating to do what it takes to solve a problem end-to-end

Benefits and Perks

  • Comprehensive medical, dental and vision coverage (U.S.)
  • Retirement and financial wellness support (U.S.)
  • Generous paid time off, plus holidays
  • Paid parental leave
  • Professional development support
  • Wellness and work-from-home stipends
  • Flexible work environment

Skills

SQLPythondbtSqlmeshETLELTData ModelingData WarehouseData GovernanceData Quality
Rippling

Staff Software Engineer

RipplingSeattle, WA +2

Build an end-to-end analytics and business intelligence Data Cloud platform at Rippling, replacing customer data lakes, warehouses, and pipelines with integrated ingestion, transformation, lineage, catalogs, and visualization. Develop large-scale data systems using Python, Trino, Iceberg and Temporal; explore ML/LLMs for automated insights.

189k – 315k
Hybrid8+ YOEData Engineering
Databricks

Staff Software Engineer - Distributed Data Systems

DatabricksSan Francisco, CA +1

Develops distributed data systems like Apache Spark and Delta Lake at massive scale, ensuring high performance and reliability for exabyte-scale workloads. Requires 8+ years in Java/Scala/C++ and deep distributed systems expertise.

192k – 260k
On-site8+ YOEData Engineering
Nuro

Senior/Staff Software Engineer, ML Data Infrastructure

NuroMountain View, CA

Build scalable data infrastructure for ML training and evaluation in autonomous driving, including batch/streaming pipelines, storage systems, dashboards, monitoring, data mining, and annotation tools. Requires 4+ years experience, Python proficiency, and engineering leadership.

194k – 352k
On-site4+ YOEData Engineering
Nuro

Senior/Staff Software Engineer, Data Platform

NuroMountain View, CA

Build scalable data platforms for autonomous driving ML systems, including batch/streaming pipelines, storage, dashboards, and monitoring. Requires 4+ years experience in large-scale data systems, Python/C++, and engineering leadership.

194k – 352k
On-site4+ YOEData Engineering
Okta

Staff Software Engineer, Data Platform

OktaSan Francisco, CA

Staff Software Engineer building and scaling Okta's high-volume, low-latency Data Platform for streaming analytics, ML, and telemetry using technologies like Kafka, Flink, and Snowflake. Requires 8+ years experience with distributed systems and Java; U.S. Person status required for FedRAMP.

194k – 267k
Hybrid8+ YOEData Engineering