# Research Engineer

**Company:** [hud](https://hotfix.jobs/companies/hud)
**Location:** San Francisco, CA
**Role:** ML Engineering
**Skills:** Python, Docker, Linux, LLMs, Data Validation, Large-Scale Datasets, Validation Pipelines, Human-In-The-Loop, AI Tools
**Posted:** 2026-04-24

> Builds QA systems, tooling, and workflows to audit and validate large-scale RL training data from suppliers. Partners with vendors to improve data quality using Python, Docker, and AI/ML techniques for frontier AI infrastructure.

## Job Description

## Responsibilities
- Define and enforce quality standards for training data
- Build tooling and workflows to audit supplier-generated datasets, including sampling strategies, validation pipelines (rule-based and model-assisted), and feedback loops
- Determine if and how human-in-the-loop review workflows can be used to optimize QA
- Partner with data vendors to debug quality issues, provide actionable feedback, and improve their data generation processes
- Continuously integrate QA learnings into infrastructure tools and data vendor portal to reduce anomalies, inconsistencies, and edge cases

## Experience
- Proficiency in Python, Docker, and Linux environments
- Worked with large-scale datasets
- Evidence of rapid learning and adaptability in technical environments (e.g., programming competitions)
- Startup experience in early-stage technology companies with ability to work independently in fast-paced environments
- Familiarity with current AI tools and LLM capabilities
- Strong communication skills for remote collaboration across time zones

## Strong candidates may also
- Understand common failure modes in training data
- Have experience building data validation pipelines and/or human-in-the-loop review systems
- Be detail-oriented and able to spot subtle inconsistencies or edge cases in data
- Be comfortable designing metrics, experiments, and QA processes, not just executing them

## Similar roles

- [CoDesign & NextGen Performance Engineer](https://hotfix.jobs/jobs/2cb728b7-a9ea-44b0-b16a-47364021f7be) - Cerebras Systems - Sunnyvale, CA
- [Research Engineer, Privacy](https://hotfix.jobs/jobs/3220c5d0-0e5f-4869-b133-1ed126b4208a) - OpenAI - San Francisco, CA - $380k – $445k/yr
- [Research Engineer](https://hotfix.jobs/jobs/b4d18018-e64d-4828-a8b4-303225328e17) - Console - San Francisco, CA - $200k – $350k/yr
- [Software Engineer, AI Platform](https://hotfix.jobs/jobs/7ddad000-3e1c-47cb-a45b-31d8e72abc4f) - Notion - San Francisco, CA - $180k – $201k/yr
- [Machine Learning Engineer](https://hotfix.jobs/jobs/97713038-58cb-46c5-a9c7-0e1554e1ba4f) - Liftoff - Remote - $215k – $275k/yr

**Apply:** https://hotfix.jobs/jobs/00085ffc-f6b5-413d-a7e9-08895fdd347c
**Canonical:** https://hotfix.jobs/jobs/00085ffc-f6b5-413d-a7e9-08895fdd347c