Build scalable data platforms for autonomous driving ML systems, including batch/streaming pipelines, storage, dashboards, and monitoring. Requires 4+ years experience in large-scale data systems, Python/C++, and engineering leadership.
194k – 352k
On-site4+ YOEData Engineering
About the role
Responsibilities
Design and develop unified, introspectable, large-scale batch and streaming data processing systems that can ingest and process data across a wide range of use cases relevant to evaluation.
Create and implement a storage system capable of accommodating both the large volume and diverse range of evaluation and performance metrics.
Construct intuitive dashboards and reports to present evaluation results, facilitating straightforward comparisons that highlight both improvements and regressions.
Design and develop comprehensive end-to-end data pipelines that streamline the flow from data ingestion to final consumption.
Develop and maintain continuous testing and monitoring systems to guarantee the integrity and resilience of our data and associated data pipelines.
Requirements
B.Sc or M.Sc. plus 4+ years of relevant work experience
Strong proficiency in Python, C++, or similar languages
Domain experience: Experience working with large scale data and building scalable & reliable systems / data pipelines; ability to understand and design complex systems
Engineering leadership: Experience setting team or project product and technical vision, timelines and prioritization; formally or informally being a Tech Lead, mentoring and support junior engineers
Technical excellence: Ability and willingness to deep dive into implementation, driving technical standards and best practices across broader software organization
Bachelor's degree in Computer Science, Electrical Engineering, or a closely related field
Nice-to-Haves
Strong knowledge of GCP, GCS, BigQuery, or PostgreSQL
Knowledge of data engineering, and its tooling and best practices
Knowledge of batch and streaming data processing, warehousing, and analytics solutions
Experience working with large scale distributed data systems
Experience with system & framework design
Experience with data workflow orchestration platforms
Compensation
Base pay range: $193,930 - $352,290
Eligible for annual performance bonus, equity, and competitive benefits package
Senior/Staff Software Engineer, ML Data Infrastructure
NuroMountain View, CA
Build scalable data infrastructure for ML training and evaluation in autonomous driving, including batch/streaming pipelines, storage systems, dashboards, monitoring, data mining, and annotation tools. Requires 4+ years experience, Python proficiency, and engineering leadership.
194k – 352k
On-site4+ YOEData Engineering
Staff Software Engineer, Data Platform
OktaSan Francisco, CA
Staff Software Engineer building and scaling Okta's high-volume, low-latency Data Platform for streaming analytics, ML, and telemetry using technologies like Kafka, Flink, and Snowflake. Requires 8+ years experience with distributed systems and Java; U.S. Person status required for FedRAMP.
194k – 267k
Hybrid8+ YOEData Engineering
Staff Data Platform Engineer
HonorUnited States
Staff Data Platform Engineer building and leading AWS-native data platform architecture, orchestration, governance, and AI-readiness for analytics and ML workloads. Requires 8-10+ years experience with AWS data systems and strong technical leadership.
194k – 220k
Remote8+ YOEData Engineering
Staff Software Engineer - Distributed Data Systems
DatabricksSan Francisco, CA +1
Develops distributed data systems like Apache Spark and Delta Lake at massive scale, ensuring high performance and reliability for exabyte-scale workloads. Requires 8+ years in Java/Scala/C++ and deep distributed systems expertise.
192k – 260k
On-site8+ YOEData Engineering
Staff Data Engineer - Data & ML Platform
Hinge HealthSan Francisco, CA
Staff Data Engineer leading architecture and reliability for a unified data platform that powers real-time experiences, analytics, and ML systems. Owns data contracts, schema evolution, observability, and standards across Kafka, Flink, PySpark, Delta Lake, and Databricks in a HIPAA-compliant environment.