Researcher, Agent Safety, Oversight and System Mitigations
Researcher or engineer focused on designing, evaluating, and productionizing oversight systems and safety mitigations for autonomous AI agents. The role requires strong systems or security reasoning, threat-modeling ability, and experience building practical evaluations and controls.
About the job
Responsibilities
- Design, build, and evaluate system-level controls for agent actions, including agent-based review.
- Plan how controls integrate with sandboxing, process isolation, and permission boundaries.
- Collaborate with Codex harness engineering to productionize AI controls.
- Red-team end-to-end agentic systems to assess prevention of data exfiltration, unsafe tool use, and other harmful outcomes.
- Measure and improve the safety–productivity tradeoff by reducing missed harmful actions, unnecessary blocks, approval burden, and latency.
Requirements
- Strong systems or security instincts, with the ability to reason about isolation boundaries, permissions, attack surfaces, and failure modes.
- Ability to turn ambiguous safety questions into threat models, reproducible experiments, and practical mitigations.
- Experience building robust experimental infrastructure and designing evaluations that distinguish effective mitigations from brittle ones.
- Deep interest in frontier AI alignment, safety, and control.
Nice-to-haves
- Background in AI control or security.
Compensation
- Annual compensation range: $380,000–$500,000.
Skills
Ai Safety, Ai Alignment, Security, Threat Modeling, Sandboxing, Process Isolation, Permission Boundaries, Red Teaming, Evaluation Design, Experimental Infrastructure, Agentic Systems, Data Exfiltration, Codex
Similar jobs
AI Research jobs
OpenAI
San Francisco, CA
Researcher focused on training and evaluating frontier AI agents, mining incidents, and building scalable safety measurement systems. The role requires strong research or ML engineering execution, quantitative judgment, and the ability to own ambiguous projects end to end.
Anthropic
San Francisco, CA
Research Engineer building large-scale AI capability evaluations, telemetry, data pipelines, and analysis tools for Anthropic’s Takeoff Intel team. The role requires hands-on large language model experimentation, rapid prototyping, data expertise, and strong research collaboration.
Thinking Machines Lab
San Francisco, CA
Research role focused on improving agentic coding capabilities through reinforcement-learning training, synthetic data, coding environments, reward design, and evaluations. Requires strong Python engineering, scalable distributed-training experience, and a bachelor’s degree or equivalent; research experience and a PhD are preferred.
Thinking Machines Lab
San Francisco, CA
Conduct AI safety research across data curation, post-training, evaluations, synthetic data, and red-teaming to improve model reliability on harmful and dual-use requests. The role requires AI safety experience, Python, deep learning frameworks, and scalable technical research skills.
Anthropic
San Francisco, CA
Conducts hands-on medicinal chemistry research to evaluate AI-generated molecules and synthetic routes, advancing small-molecule programs from design through experimental validation. Requires a chemistry PhD, sustained synthetic experience, and cross-functional collaboration skills.