Skip to content
NuroNuroMountain View, CA

Software Engineer, ML Inference Platform

Build and maintain machine learning infrastructure for autonomy teams, including model pipelines, observability, inference serving, and compiler platforms. The role requires a relevant degree, at least one year of experience, strong Python skills, and familiarity with C++.

160k – 241k/yr
On-site1+ YOEML Engineering

About the role

Responsibilities

  • Design and develop machine learning workflow pipelines to train, optimize, validate, and deploy autonomy models.
  • Develop and maintain continuous testing and monitoring systems for core machine learning infrastructure components.
  • Build observability to track machine learning model lifecycles from data generation through on-road validation.
  • Maintain an in-house machine learning inference platform to serve large language models efficiently.
  • Maintain an in-house machine learning compiler platform to compile, deploy, and validate autonomy models across hardware platforms.

Requirements

  • Bachelor's, master's, or Ph.D. degree.
  • 1+ years of relevant experience.
  • Strong proficiency in Python or similar programming languages.
  • Familiarity with C++.
  • Ability to develop software with high standards for performance, scalability, and code quality.
  • Experience working with machine learning pipelines.
  • Ability to understand and design complex distributed systems.
  • Ability and willingness to learn quickly, work independently, and improve complex systems.

Nice-to-Haves

  • Strong proficiency in C++ or other high-performance, low-level languages.
  • Experience working with large-scale distributed systems.
  • Experience with system and framework design.
  • Experience with data workflow orchestration platforms.
  • Experience with machine learning compilers.

Compensation and Benefits

  • Base pay range: $160,360–$240,540.
  • Eligible for an annual performance bonus, equity, and a competitive benefits package.

Skills

PythonC++machine learning pipelinesDistributed Systemsml workflow orchestrationcontinuous testingObservabilityml inferenceLLMsml compilersSystem Designframework designmodel deploymentData Pipelines

Similar roles

ML Engineering jobs
Nuro

Software Engineer, ML Infrastructure Platform

NuroMountain View, CA

Build and operate the infrastructure powering large-scale machine-learning training for autonomous-driving systems. The role requires Python proficiency, Kubernetes production experience, distributed-systems expertise, and ownership of reliability, observability, and operational maturity.

160k – 241k/yrOn-site1+ YOEML Engineering
Nuro

Software Engineer, ML Infrastructure, Optimization

NuroMountain View, CA

Build and optimize ML infrastructure for autonomous vehicles, focusing on model optimization, compilers, and deployment across the autonomy stack. Requires 2+ years in ML optimization and strong Python/C++/CUDA skills.

160k – 241k/yrOn-site2+ YOEML Engineering
Sprinter Health

Logistics Research Team

Sprinter HealthSan Francisco, CA

Software Engineer on the Logistics Optimization team designing and implementing algorithms for clinician routing, scheduling, dispatch, simulations, and predictive models to optimize in-home healthcare delivery at national scale. Requires 2-3 years software engineering experience with optimization, forecasting or simulation systems, preferably in TypeScript/Python.

160k – 200k/yrHybrid2+ YOEML Engineering
Baseten

Software Engineer, Model Performance Tooling

BasetenSan Francisco, CA

Builds performance benchmarking, diagnostic, and optimization tools for LLM inference on GPU clusters. Early-career role requiring Python proficiency, systems curiosity, and interest in AI hardware—no prior experience needed.

160k – 200k/yrOn-siteEntry levelML Engineering
Garner Health

Applied Scientist II

Garner HealthNew York, NY

Build and ship production algorithmic systems that improve healthcare quality, access, and cost outcomes. The role combines machine learning, optimization, experimentation, and LLM productionization, requiring at least two years of relevant industry or advanced-degree experience.

158k – 190k/yrHybrid2+ YOEML Engineering