# Research Scientist, Frontier Risk Evaluations
**Company:** [Scale AI](https://hotfix.jobs/companies/scale-ai)
**Location:** San Francisco, CA, New York, NY, Seattle, WA
**Salary:** $197K-$247K
**Experience:** 3+ years
**Skills:** Machine Learning, Generative AI, LLMs, Ml Pipelines, Evaluation Harnesses, Red-Teaming, Adversarial Testing, Ai Safety, Benchmarks, Prototyping
**Posted:** 2026-03-25
> Designs evaluation measures, harnesses, and datasets to assess risks from frontier AI systems, including dangerous capabilities testing. Collaborates with agencies, publishes methodologies for policymakers; requires 3+ years ML experience and publications in generative AI.
## Job Description
## Responsibilities
- Design and build harnesses to test AI models and systems (including agents) for dangerous capabilities such as security vulnerability exploitation, CBRN uplift, and other high-risk activities.
- Work with government agencies or other labs to collectively scope and design evaluations to measure and mitigate risks posed by advanced AI systems.
- Publish evaluation methodologies and write technical reports for policymakers.

## Requirements
- Commitment to promoting safe, secure, and trustworthy AI deployments.
- Practical experience conducting technical research collaboratively, including building and instrumenting ML pipelines, writing evaluation harnesses, and prototyping ideas from research literature.
- Track record of published research in machine learning, particularly generative AI.
- At least three years of experience addressing sophisticated ML problems in research or product development.
- Strong written and verbal communication skills for cross-functional teams.

## Nice to Have
- Experience crafting evaluations and benchmarks, or background in data science roles related to LLM technologies.
- Experience with red-teaming or adversarial testing of AI systems.
- Familiarity with AI safety policy frameworks (e.g., NIST AI RMF, EU AI Act, Korea AI Basic Act).
**Apply:** https://hotfix.jobs/jobs/research-scientist-frontier-risk-evaluations-at-scale-ai-fff54c85-716a-40de-964d-74f8c276583e
**Canonical:** https://hotfix.jobs/jobs/research-scientist-frontier-risk-evaluations-at-scale-ai-fff54c85-716a-40de-964d-74f8c276583e