# Software Engineer, ML Inference Platform

**Company:** [Nuro](https://hotfix.jobs/companies/nuro)
**Location:** Mountain View, CA
**Role:** ML Engineering
**Salary:** $160k – $241k/yr
**Experience:** 1+ years
**Skills:** Python, C++, machine learning pipelines, Distributed Systems, ml workflow orchestration, continuous testing, Observability, ml inference, LLMs, ml compilers, System Design, framework design, model deployment, Data Pipelines
**Posted:** 2026-08-11

> Build and maintain machine learning infrastructure for autonomy teams, including model pipelines, observability, inference serving, and compiler platforms. The role requires a relevant degree, at least one year of experience, strong Python skills, and familiarity with C++.

## Job Description

## Responsibilities

- Design and develop machine learning workflow pipelines to train, optimize, validate, and deploy autonomy models.
- Develop and maintain continuous testing and monitoring systems for core machine learning infrastructure components.
- Build observability to track machine learning model lifecycles from data generation through on-road validation.
- Maintain an in-house machine learning inference platform to serve large language models efficiently.
- Maintain an in-house machine learning compiler platform to compile, deploy, and validate autonomy models across hardware platforms.

## Requirements

- Bachelor's, master's, or Ph.D. degree.
- **1+ years of relevant experience.**
- Strong proficiency in Python or similar programming languages.
- Familiarity with C++.
- Ability to develop software with high standards for performance, scalability, and code quality.
- Experience working with machine learning pipelines.
- Ability to understand and design complex distributed systems.
- Ability and willingness to learn quickly, work independently, and improve complex systems.

## Nice-to-Haves

- Strong proficiency in C++ or other high-performance, low-level languages.
- Experience working with large-scale distributed systems.
- Experience with system and framework design.
- Experience with data workflow orchestration platforms.
- Experience with machine learning compilers.

## Compensation and Benefits

- Base pay range: **$160,360–$240,540**.
- Eligible for an annual performance bonus, equity, and a competitive benefits package.

## Similar roles

- [Software Engineer, ML Infrastructure Platform](https://hotfix.jobs/jobs/5ccc0259-2d85-4c10-8ed4-76d8ac33c4ea) - Nuro - Mountain View, CA - $160k – $241k/yr
- [Software Engineer, ML Infrastructure, Optimization](https://hotfix.jobs/jobs/a6b5f42b-e6f7-497c-adda-7a35b24c3eb4) - Nuro - Mountain View, CA - $160k – $241k/yr
- [Logistics Research Team](https://hotfix.jobs/jobs/929f6b1a-65f4-42d3-9422-af71df3f30bb) - Sprinter Health - San Francisco, CA - $160k – $200k/yr
- [Software Engineer, Model Performance Tooling](https://hotfix.jobs/jobs/26ede8a1-a8ce-494b-bcb9-87270ba2d333) - Baseten - San Francisco, CA - $160k – $200k/yr
- [Applied Scientist II](https://hotfix.jobs/jobs/c6c7879a-d2d0-4c0c-a46c-43a9930a8457) - Garner Health - New York, NY - $158k – $190k/yr

**Apply:** https://hotfix.jobs/jobs/74081e27-c2cd-4485-b56d-22edd2ae9e1d
**Canonical:** https://hotfix.jobs/jobs/74081e27-c2cd-4485-b56d-22edd2ae9e1d