# Software Engineer, Safeguards Evals

**Company:** [Anthropic](https://hotfix.jobs/companies/anthropic)
**Location:** San Francisco, CA, New York, NY
**Role:** ML Engineering
**Salary:** $320k – $485k/yr
**Experience:** 6+ years
**Skills:** Python, LLMs, Agentic Systems, Data Pipelines, Data Analysis, Prompt Engineering, Synthetic Data Generation, Distributed Systems, Rl Environments, Evaluation Frameworks
**Posted:** 2026-06-09

> Build evaluation infrastructure and datasets to measure how well AI agents detect misuse and policy violations. Design experiments, productionize evals into release pipelines, and improve safety investigation capabilities.

## Job Description

## Key responsibilities
- Build and own the evaluation harness for an agentic investigation system — defining metrics, test cases and grading approaches for a complex long horizon agent
- Construct high-quality eval datasets representing real-world misuse across harm areas (e.g., cyber attacks, bio weapons, influence operations), drawing from real traffic patterns and synthetic generation
- Measure agent performance end-to-end (detection precision/recall, investigation quality, robustness) and drive hill-climbing on the hardest harm areas
- Analyze coverage to identify measurement gaps, and evolve evals so they remain unsaturated and high-signal as agent capabilities advance
- Productionize successful research into regression and release pipelines that run on every agent change, prompt update, and underlying model upgrade
- Build tooling that enables policy experts to author, run, and iterate on evaluations without engineering support
- Construct RL environments to improve Claude’s safety investigation capabilities

## Minimum qualifications
- Proficiency in Python and comfort working across the stack
- Experience building and maintaining data pipelines
- Experience working with LLMs and a working understanding of their capabilities and failure modes — especially agentic systems with tool use and multi-step reasoning
- Strong data analysis skills — you can draw reliable insights from large datasets
- Ability to move fluidly between research prototyping and production-quality code
- Ability to translate ambiguous problems into concrete, testable experiments

## Preferred qualifications
- 6+ years of industry software engineering experience
- Expertise in building or contributing to agent evaluation frameworks, benchmarks, or automated grading systems
- Extensive experience in trust and safety, content moderation, or abuse detection systems
- Experience in red teaming, adversarial testing, or jailbreak research on AI systems
- Experience with synthetic data generation or data augmentation
- Experience with distributed systems or large-scale data processing
- Experience with prompt engineering or building LLM-powered applications

## Compensation and benefits
- Annual Salary: $320,000—$485,000 USD
- Location-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.
- Visa sponsorship available

## Similar roles

- [ML Infrastructure Engineer, Safeguards](https://hotfix.jobs/jobs/a201ecac-bb92-40b0-8991-819fab103aa9) - Anthropic - San Francisco, CA - $320k – $485k/yr
- [Senior Research Engineer](https://hotfix.jobs/jobs/360ac3d4-b582-40af-9228-8554d932a913) - Decagon - San Francisco, CA - $300k – $400k/yr
- [Research Engineer / Research Scientist](https://hotfix.jobs/jobs/68b1e6f3-d1ca-46f0-b588-f8ce543d60a9) - OpenAI - San Francisco, CA - $295k – $555k/yr
- [Agent Post-Training, Artifacts Research](https://hotfix.jobs/jobs/d4b6b972-df16-4526-bd39-2f4f1d0d6112) - OpenAI - San Francisco, CA - $295k – $445k/yr
- [Agent Post-Training, Computer Use Research](https://hotfix.jobs/jobs/bed644e8-5cd3-49e6-8435-b932562b96ad) - OpenAI - San Francisco, CA - $295k – $445k/yr

**Apply:** https://hotfix.jobs/jobs/f3a9ddc2-d800-4f91-939b-20343a45a632
**Canonical:** https://hotfix.jobs/jobs/f3a9ddc2-d800-4f91-939b-20343a45a632