# Senior/Staff Software Engineer, AI Agent Infrastructure

**Company:** [Nuro](https://hotfix.jobs/companies/nuro)
**Location:** Mountain View, CA
**Role:** ML Engineering
**Salary:** $194k – $352k/yr
**Experience:** 5+ years
**Skills:** LLMs, Python, Distributed Systems, inference serving, post-training, sft, rl, agent systems, Evaluation Frameworks, ML Infrastructure, quantization, kv-cache, orchestration, sandboxing
**Posted:** 2026-07-31

> Build and scale trustworthy AI agent infrastructure at Nuro, focusing on closed-loop evaluation, agent runtime/platform with isolation, and autoresearch systems for autonomous AI-driven engineering workflows. Requires deep LLM expertise, production agent experience, and strong backend/distributed systems skills.

## Job Description

## Responsibilities
- Build closed-loop measurement layer for agent workflows (acceptance, revert, override rates) to guide autonomy expansion.
- Advance autoresearch loop to unattended operation for bounded experiments, including evaluation and confidence machinery.
- Design isolation and permissioning models for agents acting on production repositories and infrastructure with full auditability.
- Develop agent-powered tooling across engineering lifecycle: code generation, review, debugging, test/CI failure attribution, knowledge retrieval, triage.
- Contribute to post-training of internal models where justified by workload.

## Requirements
- 5+ years software engineering experience (or 4+ with Master's) in CS, engineering, or equivalent.
- Deep, current knowledge of LLM research: training from scratch, data, tokenization, architecture, pretraining, SFT, preference optimization, RL.
- Strong understanding of LLM inference: attention, KV-cache, batching, quantization, speculative decoding, prefix caching, context handling and tradeoffs.
- Experience building and operating production LLM-based agent systems (tool use, orchestration, sandboxing, retrieval, memory).
- Strong backend and distributed systems experience at scale: cloud infrastructure, service design, storage, queuing.
- Strong Python programming skills.
- Opinionated about evaluation and benchmarks.
- End-to-end ownership; ability to handle underspecified problems.
- Hands-on post-training/fine-tuning experience (SFT, preference optimization, RL, distillation) with associated evaluation.
- Experience with ML training/research infrastructure: experiment orchestration, evaluation pipelines, hyperparameter search, data pipelines.
- Experience running inference serving, cost, or capacity at scale.
- Familiarity with agent architectures: planning, reflection, long-horizon memory, multi-agent coordination.
- Experience with open tool-integration protocols, plugin/skill frameworks, model-routing/gateway layers.
- Background in developer experience, platform engineering, observability, or security isolation.

## Nice-to-Haves
- Go, C++, or Rust experience in addition to Python.
- Staff-level candidates should demonstrate deeper scope and ownership.

## Similar roles

- [Senior/Staff Machine Learning Engineer, Sensor Simulation](https://hotfix.jobs/jobs/67882c92-6808-4924-b827-81f676c9980f) - Nuro - Mountain View, CA - $194k – $291k/yr
- [Senior/Staff Software Engineer, ML Infrastructure, Optimization](https://hotfix.jobs/jobs/be00f07f-f7b1-4685-9bf0-902f9d303a43) - Nuro - Mountain View, CA - $194k – $352k/yr
- [Senior/Staff Software Engineer, ML Data](https://hotfix.jobs/jobs/d3f8ceb2-77cd-4ff3-9198-7dfe9ebe891e) - Nuro - Mountain View, CA - $194k – $352k/yr
- [Staff Software Engineer, AI-Core](https://hotfix.jobs/jobs/e2048905-d170-4047-a7cc-dec07104ee7a) - Okta - San Francisco, CA - $194k – $267k/yr
- [Staff Applied Scientist](https://hotfix.jobs/jobs/ec762b2d-0711-4711-bcc7-c04144339a5a) - Lyft - San Francisco, CA - $194k – $242k/yr

**Apply:** https://hotfix.jobs/jobs/24364d61-d7a6-4968-87b5-4ca8baad95d7
**Canonical:** https://hotfix.jobs/jobs/24364d61-d7a6-4968-87b5-4ca8baad95d7