Skip to content
NuroNuroMountain View, CA

Technical Lead, Evaluation Infrastructure

Lead the Evaluation Infrastructure team building metrics, evaluation pipelines, and validation platforms for autonomous vehicle safety and iteration. Requires 4+ years experience in distributed systems and ML evaluation, plus strong Python/C++ skills and AI-native engineering practices.

194k – 291k
On-site4+ YOEML Engineering

About the role

Responsibilities

  • Build and own a unified metrics, evaluation, and validation platform — pipelines, introspection tooling, and analysis products that turn on-road and simulation logs into high-fidelity signals for autonomy iteration and driverless safety validation
  • Drive the technical bar for metric quality across both heuristic and ML-based approaches
  • Invest in the scale, reliability, and CI/CD of the evaluation stack to shorten time-to-signal for evaluation and time-to-confidence for validation, and to meet high SLAs for downstream stakeholders
  • Mentor and grow the Evaluation Infrastructure team, and champion AI-native engineering practices that compound team velocity and code quality
  • Partner with Product, Autonomy, Systems & Safety, and Simulation teams to define and execute the vision and strategy for evaluation

Requirements

  • B.Sc or M.Sc. degree plus 4 years of relevant work experience
  • Strong fluency in distributed systems, large-scale data and ML evaluation pipelines, metrics frameworks (heuristic and/or ML-based), and analytics platforms
  • Experience setting technical vision, roadmap, and prioritization for a team operating at the intersection of autonomy, safety, and data infrastructure
  • Clear, concise communicator who partners effectively with PMs, engineers, and cross-functional stakeholders
  • Ability and willingness to deep-dive into implementation
  • Sets the technical bar for metric quality, pipeline rigor, and safety-critical engineering practice
  • Strong proficiency in Python, C++, or similar languages
  • Daily user of modern AI coding assistants and agentic tools (Claude Code, Cursor, and similar), with strong intuition for where they accelerate engineering work

Nice-to-Haves

  • Knowledge of data engineering tooling and best practices
  • Knowledge of batch and streaming data processing, warehousing, and analytics solutions
  • Experience with data workflow orchestration platforms
  • Prior experience building evaluation, validation, or analytics platforms, ideally in autonomy, robotics, or safety-critical systems

Compensation & Benefits

  • Base pay range: $193,930 - $291,150/year
  • Annual performance bonus and equity
  • Competitive benefits package

Skills

PythonC++Distributed SystemsMl Evaluation PipelinesMetrics FrameworksData EngineeringBatch ProcessingStreaming DataData Workflow OrchestrationCI/CD

Similar roles

ML Engineering jobs
Nuro

Senior Software Engineer, ML Infrastructure

NuroMountain View, CA

Build and scale ML infrastructure platform for autonomous vehicle model development, focusing on automated resource provisioning, high-performance workload scheduling, and petabyte-scale data processing pipelines.

194k – 291k
On-site4+ YOEML Engineering
Nuro

Senior Software Engineer, Perception ML Data

NuroMountain View, CA

Build ML systems for perception data in autonomous vehicles, curating diverse datasets, synthetic data frameworks, and tools to identify data gaps. Requires 4+ years software engineering with Python/C++, ML implementation experience, and BS in quantitative field.

194k – 291k
On-site4+ YOEML Engineering
TruckSmarter

Senior AI Product Engineer

TruckSmarterSan Francisco, CA

Builds and architects agentic AI systems and GenAI agents for logistics software, integrating with ML workflows. Owns end-to-end feature delivery, mentors engineers, and shapes technical strategy. Requires 5+ years experience and curiosity in LLMs.

195k – 225k
On-site5+ YOEML Engineering
Instacart

Senior Software Engineer II, ML/AI Platform

InstacartUnited States

As a Senior Software Engineer II on the ML/AI Platform team, you will build and define the internal platform for training and deploying AI models across the organization. This role involves developing SDKs and supporting infrastructure for AI model fine-tuning and batch inference.

192k – 242k
Remote3+ YOEML Engineering
Instacart

Senior Software Engineer II, AI Labs & Foundations

InstacartUnited States

Instacart is seeking a Senior Software Engineer II for their AI Labs & Foundations team to design, build, and operate high-scale production AI systems. This role involves working on cutting-edge AI experiences like conversational shopping agents and voice AI, requiring expertise in robust software engineering and production AI/ML.

192k – 242k
Remote5+ YOEML Engineering