# Research Scientist, Frontier Risk Evaluations

**Company:** [Scale AI](https://hotfix.jobs/companies/scale-ai)
**Location:** San Francisco, CA, New York, NY, Seattle, WA
**Role:** AI Research
**Salary:** $197k – $247k/yr
**Experience:** 3+ years
**Skills:** Machine Learning, Generative AI, LLMs, Ml Pipelines, Evaluation Harnesses, Red-Teaming, Adversarial Testing, Ai Safety, Benchmarks, Prototyping
**Posted:** 2026-03-25

> Designs evaluation measures, harnesses, and datasets to assess risks from frontier AI systems, including dangerous capabilities testing. Collaborates with agencies, publishes methodologies for policymakers; requires 3+ years ML experience and publications in generative AI.

## Job Description

## Responsibilities
- Design and build harnesses to test AI models and systems (including agents) for dangerous capabilities such as security vulnerability exploitation, CBRN uplift, and other high-risk activities.
- Work with government agencies or other labs to collectively scope and design evaluations to measure and mitigate risks posed by advanced AI systems.
- Publish evaluation methodologies and write technical reports for policymakers.

## Requirements
- Commitment to promoting safe, secure, and trustworthy AI deployments.
- Practical experience conducting technical research collaboratively, including building and instrumenting ML pipelines, writing evaluation harnesses, and prototyping ideas from research literature.
- Track record of published research in machine learning, particularly generative AI.
- At least three years of experience addressing sophisticated ML problems in research or product development.
- Strong written and verbal communication skills for cross-functional teams.

## Nice to Have
- Experience crafting evaluations and benchmarks, or background in data science roles related to LLM technologies.
- Experience with red-teaming or adversarial testing of AI systems.
- Familiarity with AI safety policy frameworks (e.g., NIST AI RMF, EU AI Act, Korea AI Basic Act).

## Similar roles

- [Research Scientist, AI Controls and Monitoring](https://hotfix.jobs/jobs/f3e18621-85f5-46d2-b41c-8ac22e105ee9) - Scale AI - San Francisco, CA - $197k – $247k/yr
- [Research Scientist, Agent Robustness](https://hotfix.jobs/jobs/6ab91c5e-6084-4fcb-8280-cc605af029d2) - Scale AI - San Francisco, CA - $197k – $247k/yr
- [Research Scientist](https://hotfix.jobs/jobs/bafcccc2-823d-43e6-8b59-489f23d0c2e2) - Hedra - San Francisco, CA - $200k – $325k/yr
- [AI Researcher, Core ML (Turbo)](https://hotfix.jobs/jobs/8c5b12c6-0233-4184-8ce9-9058ce02a2fe) - Together AI - San Francisco, CA - $200k – $280k/yr
- [Founding ML Researcher](https://hotfix.jobs/jobs/7b0dd9ef-0c31-4755-963e-e53665d9162e) - Unsiloed AI - San Francisco, CA - $200k – $300k/yr

**Apply:** https://hotfix.jobs/jobs/fff54c85-716a-40de-964d-74f8c276583e
**Canonical:** https://hotfix.jobs/jobs/fff54c85-716a-40de-964d-74f8c276583e