Skip to content
Applied IntuitionApplied IntuitionSunnyvale, CA

Data & ML Pipeline Software Engineer

Builds large-scale data processing pipelines and ML infrastructure to automate data curation, model training, and iteration for autonomous vehicles using real-world and simulation data. Requires 3-5 years experience in data/ML infra, Python, and frameworks like Spark/Airflow/Kafka.

125k – 222k
On-site3+ YOEData Engineering

About the role

Responsibilities

  • Build and maintain large-scale data processing pipelines (ETL) for ingesting and curating driving datasets.
  • Design and implement systems that automate data selection, labeling, training, and testing loops.
  • Collaborate with modeling teams to improve training efficiency and model performance across iterations.
  • Develop the core infrastructure that closes the loop between real-world test results and new model deployments.
  • Use engineering expertise to help vehicles learn from data at scale, improving safety and performance.
  • Mentor junior engineers and contribute to defining best practices for data-centric development.

Requirements

  • Bachelor's or higher degree in Engineering such as Computer Science, Electrical Engineering, Software Engineering.
  • 3–5 years of experience in software or data infrastructure engineering.
  • Expertise in building and scaling data pipelines, distributed systems, or ML infrastructure.
  • Proficiency in Python and strong knowledge of data frameworks (Spark, Airflow, Kafka, etc.).
  • Experience working with large-scale datasets and understanding data-driven development cycles.
  • Familiarity with machine learning workflows or model training/deployment, especially automation of those processes.
  • Strong systems thinking and ability to work across multiple parts of the stack (data, infra, and ML).
  • Interest in seeing the direct impact of infrastructure work on vehicle performance.

Nice to Have

  • Experience with automotive (AV) or robotics systems.
  • Previous work on ML platforms for large-scale products (e.g., Ads, Recommendation, or Autonomy pipelines).
  • Experience with highly automated ML training workflows.
  • Prior contributions to systems that connect data-driven model iteration loops ("data flywheel").
  • Ability to move fast, learn quickly, and mentor others while growing with the team.

Compensation

  • Base salary range: $125,000 - $222,000 USD annually.
  • Equity, comprehensive health/dental/vision/life/disability insurance, 401k with employer match, learning/wellness stipends, paid time off.

Skills

PythonSparkAirflowKafkaDistributed SystemsETLMachine LearningData PipelinesML Infrastructure
xAI

Software Engineer

xAIPalo Alto, CA

Build and operate realtime and batch data pipelines processing billions of events daily at xAI. Design distributed data platforms, own data correctness, create shared datasets for product and business teams, and partner on data acquisition using tools like Spark, Kafka, Flink, and SQL.

125k – 400k
On-site3+ YOEData Engineering
Axle

Bioinformatics Engineer

AxleRockville, MD

Develop and optimize Nextflow-based bioinformatics pipelines for high-throughput sequencing analysis on Google Cloud Platform. Requires 3+ years of production pipeline experience, Nextflow proficiency, and strong genomics analysis skills.

125k – 150k
On-site3+ YOEData Engineering
Permitflow

Analytics Engineer

PermitflowNew York, NY

Builds and maintains scalable data pipelines, models, and warehouses to enable business intelligence and decision-making. Collaborates with teams on data integration, governance, and self-serve analytics using SQL, dbt, Python, and BI tools. Requires 3+ years experience.

125k – 215k
Hybrid3+ YOEData Engineering
Pinterest

Software Engineer II, Big Data, tvScientific

PinterestSan Francisco, CA

Design and implement scalable data infrastructure using Spark/Scala on AWS. Build data pipelines, knowledge graphs, and APIs to support a high-growth CTV advertising platform.

124k – 255k
RemoteData Engineering
Brex

Data Engineer

BrexSan Francisco, CA

Build and maintain scalable data models, pipelines, and Core Data tables to transform raw data into actionable insights. Collaborate with data scientists and business teams using SQL, DBT, Snowflake, Airflow, and Python.

121k – 151k
Hybrid3+ YOEData Engineering