Skip to content
OpenAIOpenAISan Francisco, CA

Research Engineer/Scientist - Human Alignment, Consumer Devices

Develops RLHF and post-training methods for personalized, multimodal AI systems on consumer devices, focusing on reward modeling, preference learning, long-horizon evaluation, and alignment with user values. Requires strong ML research background in RLHF and related areas.

380k – 445k
HybridAI Research

About the role

Responsibilities

  • Develop RLHF and post-training methods for multimodal models.
  • Build reward models and preference-learning pipelines for adaptive, personalized model behavior.
  • Design datasets, rubrics, and evaluation frameworks that capture user preferences, contextual appropriateness, and long-term value in realistic tasks.
  • Run experiments on policy improvement using explicit feedback, implicit signals, and model-based grading.
  • Work on long-horizon evaluation problems, where model quality depends on behavior improving outcomes over time.
  • Collaborate closely with safety researchers to ensure adaptation and personalization remain aligned, interpretable, and bounded by clear constraints.
  • Prototype and iterate quickly on training recipes, reward formulations, data pipelines, and evaluation suites for product-relevant behaviors.
  • Help define how success is measured for personalized AI systems including trust, appropriateness, and long-term user benefit.

Requirements

  • Strong background in machine learning research, with experience in RLHF, reward modeling, preference optimization, or post-training for large models.
  • Experience in one or more of: reinforcement learning, ranking, recommender systems, personalization, memory, or human-in-the-loop evaluation.
  • Care about rigorous empirical work and know how to design clean experiments, reliable evals, and decision-useful metrics.
  • Experience building datasets or eval pipelines grounded in human preferences, rubrics, or real-world product behavior.
  • Comfortable working across the stack, from data generation and labeling strategy to training runs, reward functions, and analysis.
  • Interest in multimodal AI and how models can learn from richer interaction signals over time.

Skills

RLHFReward ModelingPreference OptimizationReinforcement LearningMultimodal AiPost-TrainingMachine LearningEvaluation FrameworksDatasetsPolicy Improvement

Similar roles

AI Research jobs
OpenAI

Researcher, Trustworthy AI

OpenAISan Francisco, CA

Conducts research on societal impacts of AI models, translates policy problems into technical evaluations, and develops interventions for safe AGI deployment. Requires 3+ years research experience, Python proficiency, and expertise in AI safety techniques like RLHF.

380k – 380k
Hybrid3+ YOEAI Research
Runway

Research Science Manager, Foundation Models

RunwayUnited States

Leads Applied ML Research team focused on computer vision and foundation models for AI content creation and world simulation. Requires 5+ years research experience, 1+ year managing teams, and skills in productionizing ML research.

360k – 450k
Remote5+ YOEAI Research
Thinking Machines Lab

Research, Pre-Training Science

Thinking Machines LabSan Francisco, CA

Conducts research on pre-training methodologies for large AI models, develops new architectures and data strategies, runs large-scale experiments, and publishes findings. Requires strong ML fundamentals, Python proficiency, and experience with deep learning frameworks.

350k – 475k
On-siteAI Research
Thinking Machines Lab

Research, Audio Expertise

Thinking Machines LabSan Francisco, CA

Conducts research to advance audio capabilities in AI models, designing and training large-scale multimodal systems, building audio data pipelines, and publishing findings. Requires ML expertise, Python proficiency, and experience with deep learning frameworks.

350k – 475k
On-siteAI Research
Anthropic

Research Scientist, Interpretability

AnthropicSan Francisco, CA

Conducts mechanistic interpretability research to reverse-engineer language models, developing methods to understand neural network algorithms for AI safety. Requires scientific research background, Python proficiency, and collaborative engineering mindset.

350k – 850k
HybridAI Research