# Software Engineer, Applied AI Infrastructure

**Company:** [Nuro](https://hotfix.jobs/companies/nuro)
**Location:** Mountain View, CA, California
**Role:** ML Engineering
**Salary:** $194k – $352k/yr
**Experience:** 5+ years
**Skills:** Python, Go, C++, Rust, Llm Agents, Distributed Systems, Cloud Infrastructure, Kubernetes, Inference Serving, Model Training, Fine-Tuning, Reinforcement Learning, Evaluation Pipelines, Observability, Security Isolation
**Posted:** 2026-08-11

> Build trustworthy infrastructure for production LLM agents, closed-loop evaluation, and autonomous research workflows. The role requires strong Python and distributed-systems experience, hands-on LLM post-training and inference knowledge, and experience operating agent systems at scale.

## Job Description

## Responsibilities
- Build a closed-loop measurement layer tracking whether agent output is accepted, reverted, or overridden, and use those results to determine where autonomy expands or is restricted.
- Advance the autoresearch loop from assisted to unattended operation for bounded experiments, including evaluation and confidence mechanisms for human-free execution.
- Design isolation and permissioning models that allow agents to operate on production repositories and infrastructure with auditable records of actions and rationale.
- Build and operate agent infrastructure, including orchestration, sandboxing, tool and skill frameworks, memory, identity and permissions, gateways, and observability.
- Develop automation for model research workflows, including experiment launch, evaluation, metric analysis, and proposal generation.
- Create agent-powered tools for code generation, code review, debugging, test and CI failure attribution, knowledge retrieval, and triage.
- Contribute to post-training models when internal workloads justify it.

## Requirements
- 3+ years of software engineering experience, or 2+ years with a master's degree, in computer science, engineering, or equivalent practical experience.
- Staff-level candidates should bring correspondingly deeper scope and ownership.
- Deep, current knowledge of LLM research, including data, tokenization, architecture, pretraining dynamics, supervised fine-tuning, preference optimization, and reinforcement learning.
- Understanding of inference systems, including attention, KV caches, batching, scheduling, quantization, speculative decoding, prefix caching, and context handling.
- Experience building and operating LLM-based agent systems in production, including tool use, orchestration, sandboxing, retrieval, and memory.
- Strong backend and distributed-systems experience at scale, including cloud infrastructure, service design, storage, and queuing.
- Strong Python programming skills.
- Hands-on post-training or fine-tuning experience, including SFT, preference optimization, reinforcement learning, distillation, and evaluation.
- Experience with ML training or research infrastructure, experiment orchestration, evaluation pipelines, hyperparameter search, or data pipelines.
- Experience operating inference serving, cost, or capacity at meaningful scale.
- Experience with agent architecture patterns such as planning, reflection, long-horizon memory, or multi-agent coordination.
- Experience with open tool-integration protocols, plugin or skill frameworks, and model-routing or gateway layers.
- Background in developer experience, platform engineering, observability, or security isolation.

## Nice to Haves
- Go, C++, or Rust experience in addition to Python.
- Experience working directly with autonomous research and training pipelines.

## Compensation
- Expected base pay range: **$193,930–$352,290**.
- Base pay depends on experience, qualifications, education, location, and skills.

## Similar jobs

- [AI Builder](https://hotfix.jobs/jobs/e3844b1a-526b-4324-b313-73878226da14) - Earnin - Mountain View, CA - $189k – $231k/yr
- [Machine Learning Engineer, Ranking & Retrieval](https://hotfix.jobs/jobs/adb5411d-8bfc-48b8-a8e7-15cbf5ea21b2) - ClickUp - Remote - $200k – $250k/yr
- [MLOps Engineer](https://hotfix.jobs/jobs/53345898-6983-49bb-9b96-8bd092cce380) - Atomicmachines - Emeryville, CA - $200k – $250k/yr
- [Research Engineer](https://hotfix.jobs/jobs/b7f882b3-691d-4e25-bb77-dd291f34664c) - Tessera Labs - San Jose, CA - $200k – $300k/yr
- [AI Engineer](https://hotfix.jobs/jobs/6643da73-b45f-4533-bd6c-fe05f90d52fb) - Tessera Labs - San Jose, CA - $200k – $250k/yr

**Apply:** https://hotfix.jobs/jobs/857fb66b-5a30-49f6-92e9-cfc2f4a921aa
**Canonical:** https://hotfix.jobs/jobs/857fb66b-5a30-49f6-92e9-cfc2f4a921aa