Develops safe and reliable AI models for healthcare applications using techniques like RLHF, automated red teaming, and scalable oversight. Requires PhD, 4+ years in deep learning/LLM research, and focus on practical AI safety improvements.
295k – 445k/yr
Hybrid4+ YOEAI Research
About the role
Responsibilities
Design and apply practical and scalable methods to improve safety and reliability of our models, including RLHF, automated red teaming, scalable oversight, etc.
Evaluate methods using health-related data, ensuring models provide accurate, reliable, and trustworthy information.
Build reusable libraries for applying general alignment techniques to our models.
Proactively understand the safety of our models and systems, identifying areas of risk.
Work with cross-team stakeholders to integrate methods in core model training and launch safety improvements in OpenAI’s products.
Requirements
4+ years of experience with deep learning research and LLMs, especially practical alignment topics such as RLHF, automated red teaming, scalable oversight, etc.
Ph.D. or other degree in computer science, AI, machine learning, or a related field.
Stay goal-oriented instead of method-oriented, and are not afraid of unglamorous but high-value work when needed.
Possess experience making practical model improvements for AI model deployment.
Own problems end-to-end, and are willing to pick up whatever knowledge you're missing to get the job done.
Are a team player who enjoys collaborative work environments.
Nice-to-haves
Experience in health-related AI research or deployments.
Skills
LLMsRLHFDeep LearningAutomated Red TeamingScalable OversightAi SafetyAi AlignmentHealth Ai
Designs worst-case demonstrations and adversarial evaluations to uncover AGI misalignment risks like deception and power-seeking. Builds automated stress-testing infrastructure and researches alignment failure modes to inform OpenAI's safety strategy. Requires 4+ years in AI red-teaming or adversarial ML.
295k – 445k/yr
On-site4+ YOEAI Research
Researcher, Loss of Control
OpenAISan Francisco, CA
Designs and implements mitigation stacks to prevent loss of control risks in frontier AI models, including prevention, monitoring, detection, and enforcement. Requires expertise in deep learning, transformers, PyTorch/TensorFlow, and AI safety research.
295k – 445k/yr
On-siteAI Research
Researcher, Synthetic RL
OpenAISan Francisco, CA
Develops novel reinforcement learning techniques using synthetic environments and feedback to enhance large-scale AI models. Designs experiments, analyzes dynamics, and integrates research into production systems; requires strong RL/ML background and engineering skills.
295k – 445k/yr
HybridAI Research
Research Engineer / Research Scientist, Post-Training
OpenAISan Francisco, CA
Research and develop improvements to pre-trained models for deployment in ChatGPT and API using reinforcement learning and product-driven approaches. Requires strong ML engineering, research experience with novel models, and ability to debug large codebases.
295k – 555k/yr
HybridAI Research
Researcher, Pretraining Safety
OpenAISan Francisco, CA
Develop techniques to predict and mitigate unsafe behaviors in early-stage base models, design safer pretraining architectures, and integrate safety signals throughout training. Collaborate across safety teams to build robust, scalable safety foundations grounded in real-world risks.