# AI Engineer, Internal Systems

**Company:** [Wispr Flow](https://hotfix.jobs/companies/wispr-flow)
**Location:** San Francisco, CA
**Role:** ML Engineering
**Salary:** $220k – $300k/yr
**Skills:** Agentic Coding, Evaluation Infrastructure, Verification Infrastructure, Test Harnesses, Ci Systems, Evaluation Pipelines, Benchmarks, Application Development, Infrastructure, Production Systems
**Posted:** 2026-09-12

> Build verification, evaluation, and testing systems that allow AI agents to determine when work is complete and operate reliably in production. The role requires experience with internal tools, agentic coding workflows, evaluation infrastructure, and hands-on application and infrastructure development.

## Job Description

## Responsibilities
- Build end-to-end verification loops that enable agents to determine when their work is complete.
- Create fast, reliable testing environments and convert failures and human feedback into durable evaluation signals.
- Improve how context, instructions, skills, and memory are delivered to agents, and measure what improves their performance.
- Operate the agent fleet as a production system while measuring quality, adoption, and impact.

## Requirements
- Experience building internal tools adopted by other engineers and explaining how their impact was measured.
- Deep use of agentic coding tools, with informed perspectives on their strengths and limitations.
- Experience building evaluation or verification infrastructure, such as test harnesses, CI systems, evaluation pipelines, or benchmarks.
- Ability to work hands-on across application code, infrastructure, and unfamiliar systems.
- Empirical approach to work, attention to subtle failure modes, and comfort owning ambiguous problems.

## Nice-to-haves
- Prior experience in voice, model training, or related product domains.

## Similar jobs

- [AI/ML Engineer](https://hotfix.jobs/jobs/c4ec2979-ed97-4e7b-9084-fb3f6179add5) - Cinder - New York, NY - $220k – $260k/yr
- [Member of Technical Staff](https://hotfix.jobs/jobs/7f36e0f1-d01f-4eeb-bb83-4a2056256a5e) - Perplexity - San Francisco, CA - $220k – $405k/yr
- [Machine Learning Engineer](https://hotfix.jobs/jobs/7da1481e-3c05-4f34-92f6-af12f1cc55d0) - Firecrawl - San Francisco, CA - $210k – $240k/yr
- [Machine Learning Engineer, Ranking & Retrieval](https://hotfix.jobs/jobs/adb5411d-8bfc-48b8-a8e7-15cbf5ea21b2) - ClickUp - Remote - $200k – $250k/yr
- [MLOps Engineer](https://hotfix.jobs/jobs/53345898-6983-49bb-9b96-8bd092cce380) - Atomicmachines - Emeryville, CA - $200k – $250k/yr

**Apply:** https://hotfix.jobs/jobs/36e5a83d-413c-4824-9676-d159c12d8a47
**Canonical:** https://hotfix.jobs/jobs/36e5a83d-413c-4824-9676-d159c12d8a47