Skip to content
Scale AIScale AISan Francisco, CA

Research Scientist, Frontier Risk Evaluations

Designs evaluation measures, harnesses, and datasets to assess risks from frontier AI systems, including dangerous capabilities testing. Collaborates with agencies, publishes methodologies for policymakers; requires 3+ years ML experience and publications in generative AI.

197k – 247k/yr
On-site3+ YOEAI Research

About the role

Responsibilities

  • Design and build harnesses to test AI models and systems (including agents) for dangerous capabilities such as security vulnerability exploitation, CBRN uplift, and other high-risk activities.
  • Work with government agencies or other labs to collectively scope and design evaluations to measure and mitigate risks posed by advanced AI systems.
  • Publish evaluation methodologies and write technical reports for policymakers.

Requirements

  • Commitment to promoting safe, secure, and trustworthy AI deployments.
  • Practical experience conducting technical research collaboratively, including building and instrumenting ML pipelines, writing evaluation harnesses, and prototyping ideas from research literature.
  • Track record of published research in machine learning, particularly generative AI.
  • At least three years of experience addressing sophisticated ML problems in research or product development.
  • Strong written and verbal communication skills for cross-functional teams.

Nice to Have

  • Experience crafting evaluations and benchmarks, or background in data science roles related to LLM technologies.
  • Experience with red-teaming or adversarial testing of AI systems.
  • Familiarity with AI safety policy frameworks (e.g., NIST AI RMF, EU AI Act, Korea AI Basic Act).

Skills

Machine LearningGenerative AILLMsMl PipelinesEvaluation HarnessesRed-TeamingAdversarial TestingAi SafetyBenchmarksPrototyping

Similar roles

AI Research jobs
Scale AI

Research Scientist, AI Controls and Monitoring

Scale AISan Francisco, CA +1

Designs methods, systems, and experiments for AI controls and monitoring to ensure alignment in high-stakes environments, including real-time tracking, fail-safes, and red-team simulations. Requires 3+ years ML experience, published research in generative AI, and strong prototyping skills.

197k – 247k/yr
Hybrid3+ YOEAI Research
Scale AI

Research Scientist, Agent Robustness

Scale AISan Francisco, CA +1

Research Scientist focuses on agent robustness, developing tests, exploits, and mitigations for safe AI agents. Requires 3+ years ML experience, RL techniques like RLHF/DPO, and published research in generative AI.

197k – 247k/yr
Hybrid3+ YOEAI Research
Hedra

Research Scientist

HedraSan Francisco, CA

Leads original research in action-conditioned world models, physical AI, and generative modeling for embodied systems. Requires PhD in ML/CS/Robotics with top publications and expertise in generative models and large-scale training.

200k – 325k/yr
On-siteAI Research
Together AI

AI Researcher, Core ML (Turbo)

Together AISan Francisco, CA

Develops efficient inference engines and RL/post-training pipelines for production-scale LLMs, optimizing algorithms, systems, and performance across the stack. Requires 3+ years in ML systems/RL/inference and advanced degree.

200k – 280k/yr
On-site3+ YOEAI Research
Unsiloed AI

Founding ML Researcher

Unsiloed AISan Francisco, CA

Founding ML Researcher shapes ML research direction for document AI, owns end-to-end lifecycle from research to production deployment. Requires expertise in VLMs, computer vision, unstructured data parsing; PhD preferred.

200k – 300k/yr
On-siteAI Research