# Research Engineer/Scientist - Human Alignment, Consumer Devices

**Company:** [OpenAI](https://hotfix.jobs/companies/openai)
**Location:** San Francisco, CA
**Role:** AI Research
**Salary:** $380k – $445k/yr
**Skills:** RLHF, Reward Modeling, Preference Optimization, Reinforcement Learning, Multimodal Ai, Post-Training, Machine Learning, Evaluation Frameworks, Datasets, Policy Improvement
**Posted:** 2026-03-11

> Develops RLHF and post-training methods for personalized, multimodal AI systems on consumer devices, focusing on reward modeling, preference learning, long-horizon evaluation, and alignment with user values. Requires strong ML research background in RLHF and related areas.

## Job Description

## Responsibilities
- Develop RLHF and post-training methods for multimodal models.
- Build reward models and preference-learning pipelines for adaptive, personalized model behavior.
- Design datasets, rubrics, and evaluation frameworks that capture user preferences, contextual appropriateness, and long-term value in realistic tasks.
- Run experiments on policy improvement using explicit feedback, implicit signals, and model-based grading.
- Work on long-horizon evaluation problems, where model quality depends on behavior improving outcomes over time.
- Collaborate closely with safety researchers to ensure adaptation and personalization remain aligned, interpretable, and bounded by clear constraints.
- Prototype and iterate quickly on training recipes, reward formulations, data pipelines, and evaluation suites for product-relevant behaviors.
- Help define how success is measured for personalized AI systems including trust, appropriateness, and long-term user benefit.

## Requirements
- Strong background in machine learning research, with experience in RLHF, reward modeling, preference optimization, or post-training for large models.
- Experience in one or more of: reinforcement learning, ranking, recommender systems, personalization, memory, or human-in-the-loop evaluation.
- Care about rigorous empirical work and know how to design clean experiments, reliable evals, and decision-useful metrics.
- Experience building datasets or eval pipelines grounded in human preferences, rubrics, or real-world product behavior.
- Comfortable working across the stack, from data generation and labeling strategy to training runs, reward functions, and analysis.
- Interest in multimodal AI and how models can learn from richer interaction signals over time.

## Similar roles

- [Researcher, Trustworthy AI](https://hotfix.jobs/jobs/b14fb4a0-176e-4a6b-a8d1-f49e74ae87c1) - OpenAI - San Francisco, CA - $380k – $380k/yr
- [Research Science Manager, Foundation Models](https://hotfix.jobs/jobs/44e910f9-4690-47d1-956c-a64a2d403ec8) - Runway - Remote - $360k – $450k/yr
- [Research, Pre-Training Science](https://hotfix.jobs/jobs/1632c257-f81d-4db4-87a7-ee81864adee1) - Thinking Machines Lab - San Francisco, CA - $350k – $475k/yr
- [Research, Audio Expertise](https://hotfix.jobs/jobs/4d683697-adb2-4f5d-b26e-33ed1b92740c) - Thinking Machines Lab - San Francisco, CA - $350k – $475k/yr
- [Research Scientist, Interpretability](https://hotfix.jobs/jobs/b82b1f34-1f5f-4178-96bf-2c997705b2fe) - Anthropic - San Francisco, CA - $350k – $850k/yr

**Apply:** https://hotfix.jobs/jobs/e190c892-d527-4b9d-a9af-faa652c44ad8
**Canonical:** https://hotfix.jobs/jobs/e190c892-d527-4b9d-a9af-faa652c44ad8