Skip to content
NuroNuroMountain View, CA

Senior/Staff Software Engineer, AI Agent Infrastructure

Build and scale trustworthy AI agent infrastructure at Nuro, focusing on closed-loop evaluation, agent runtime/platform with isolation, and autoresearch systems for autonomous AI-driven engineering workflows. Requires deep LLM expertise, production agent experience, and strong backend/distributed systems skills.

194k – 352k/yr
On-site5+ YOEML Engineering

About the role

Responsibilities

  • Build closed-loop measurement layer for agent workflows (acceptance, revert, override rates) to guide autonomy expansion.
  • Advance autoresearch loop to unattended operation for bounded experiments, including evaluation and confidence machinery.
  • Design isolation and permissioning models for agents acting on production repositories and infrastructure with full auditability.
  • Develop agent-powered tooling across engineering lifecycle: code generation, review, debugging, test/CI failure attribution, knowledge retrieval, triage.
  • Contribute to post-training of internal models where justified by workload.

Requirements

  • 5+ years software engineering experience (or 4+ with Master's) in CS, engineering, or equivalent.
  • Deep, current knowledge of LLM research: training from scratch, data, tokenization, architecture, pretraining, SFT, preference optimization, RL.
  • Strong understanding of LLM inference: attention, KV-cache, batching, quantization, speculative decoding, prefix caching, context handling and tradeoffs.
  • Experience building and operating production LLM-based agent systems (tool use, orchestration, sandboxing, retrieval, memory).
  • Strong backend and distributed systems experience at scale: cloud infrastructure, service design, storage, queuing.
  • Strong Python programming skills.
  • Opinionated about evaluation and benchmarks.
  • End-to-end ownership; ability to handle underspecified problems.
  • Hands-on post-training/fine-tuning experience (SFT, preference optimization, RL, distillation) with associated evaluation.
  • Experience with ML training/research infrastructure: experiment orchestration, evaluation pipelines, hyperparameter search, data pipelines.
  • Experience running inference serving, cost, or capacity at scale.
  • Familiarity with agent architectures: planning, reflection, long-horizon memory, multi-agent coordination.
  • Experience with open tool-integration protocols, plugin/skill frameworks, model-routing/gateway layers.
  • Background in developer experience, platform engineering, observability, or security isolation.

Nice-to-Haves

  • Go, C++, or Rust experience in addition to Python.
  • Staff-level candidates should demonstrate deeper scope and ownership.

Skills

LLMsPythonDistributed Systemsinference servingpost-trainingsftrlagent systemsEvaluation FrameworksML Infrastructurequantizationkv-cacheorchestrationsandboxing

Similar roles

ML Engineering jobs
Nuro

Senior/Staff Machine Learning Engineer, Sensor Simulation

NuroMountain View, CA

Develop synthetic sensor simulation models and algorithms using ML techniques like NeRF and Gaussian splatting to generate photorealistic images and realistic lidar/radar data for autonomous vehicles. Requires advanced degree plus 3-5+ years experience, strong ML fundamentals, and Python/deep learning expertise.

194k – 291k/yrOn-site5+ YOEML Engineering
Nuro

Senior/Staff Software Engineer, ML Infrastructure, Optimization

NuroMountain View, CA

Build and optimize ML infrastructure for autonomous vehicles, focusing on model optimization, compilers, and deployment of large models to Nuro's self-driving fleet. Requires 3+ years ML optimization experience and strong Python/C++/CUDA skills.

194k – 352k/yrOn-site3+ YOEML Engineering
Nuro

Senior/Staff Software Engineer, ML Data

NuroMountain View, CA

Senior/Staff Software Engineer architects ML data pipelines for autonomy AI at Nuro, transforming massive datasets into training signals. Requires 7+ years experience, C++/Python proficiency, and expertise in end-to-end ML data systems.

194k – 352k/yrOn-site7+ YOEML Engineering
Okta

Staff Software Engineer, AI-Core

OktaSan Francisco, CA

Build and own core layers of a scalable Agentic AI platform for autonomous engineering agents at Okta, including agent identity/auth, knowledge/memory, observability, governance/safety, and orchestration. Requires 5+ years backend engineering experience plus AI/agent exposure; strong distributed systems and security knowledge.

194k – 267k/yrHybrid7+ YOEML Engineering
Lyft

Staff Applied Scientist

LyftSan Francisco, CA

Develop and productionalize ML and optimization models for Lyft's pricing and ETA systems. Requires advanced degree, production ML/algorithms experience, and Python proficiency to solve large-scale marketplace problems.

194k – 242k/yrHybrid7+ YOEML Engineering