Skip to content
OpenAIOpenAISan Francisco, CA

Research Engineer, Frontier Evals & Environments

Builds ambitious RL environments and evaluation systems to measure and steer frontier AI models toward safe AGI. Requires strong ML research engineering, statistical skills, and red-teaming mindset for end-to-end project ownership in fast-paced setting.

$205k – $380k/yr
On-siteAI Research

About the job

Responsibilities

  • Create ambitious RL environments to push our models to their limits
  • Work on measuring frontier model capabilities, skills, and behaviors
  • Develop new methodologies for automatically exploring the behavior of these models
  • Help steer training for our largest training runs, and see the future first
  • Design scalable systems and processes to support continuous evaluation
  • Build self-improvement loops to automate model understanding

Requirements

  • Passionate and knowledgeable about AGI/ASI measurement
  • Strong engineering and statistical analysis skills
  • Able to think outside the box and have a robust “red-teaming mindset”
  • Experienced in ML research engineering, stochastic systems, observability and monitoring, LLM-enabled applications, and/or another technical domain applicable to AI evaluations
  • Able to operate effectively in a dynamic and extremely fast-paced research environment as well as scope and deliver projects end-to-end

Nice-to-haves

  • First-hand experience in red-teaming systems—be it computer systems or otherwise
  • An ability to work cross-functionally
  • Excellent communication skills

Skills

Reinforcement LearningMachine LearningLLMsStatistical AnalysisRed-TeamingObservabilityMonitoringStochastic SystemsRl EnvironmentsModel Evaluation

Similar jobs

AI Research jobs
Abridge

Machine Learning Scientist (All Levels)

AbridgeSan Francisco, CA +1

Conducts machine learning research in medical NLP for conversation summarization, evidence extraction, and outcome prediction. Publishes at top AI conferences, deploys models to production, and requires MS/PhD plus strong PyTorch/TensorFlow experience.

$205k – $300k/yrHybridAI Research
Mercor

Research Scientist, APEX Benchmarks

MercorSan Francisco, CA

Leads the design, measurement, publication, and adoption of APEX benchmarks evaluating frontier models on economically valuable professional work. The role requires rigorous research judgment, strong coding and statistical skills, and excellent communication across technical, commercial, and research audiences.

$200k – $400k/yrOn-siteAI Research
Tessera Labs

Research Scientist

Tessera LabsSan Jose, CA

Research Scientist defining and executing research on reliable long-horizon agents in enterprise environments. The role focuses on post-training and reinforcement learning, agent memory, evaluation, verification, and structured representations, combining hands-on experimentation with product delivery and publication.

$200k – $300k/yrOn-siteAI Research
Hedra

Research Scientist

HedraSan Francisco, CA

Leads original research in action-conditioned world models, physical AI, and generative modeling for embodied systems. Requires PhD in ML/CS/Robotics with top publications and expertise in generative models and large-scale training.

$200k – $325k/yrOn-siteAI Research
Baseten

Post-Training Research Scientist

BasetenSan Francisco, CA

Conducts research on post-training methodologies and performant inference for AI models, balancing pure research with applied work for production systems. Requires PhD in ML with top publications and ability to design rigorous experiments at scale.

$210k – $285k/yrHybridAI Research