Skip to content
hudhudSan Francisco, CA

Research Engineer

Builds QA systems, tooling, and workflows to audit and validate large-scale RL training data from suppliers. Partners with vendors to improve data quality using Python, Docker, and AI/ML techniques for frontier AI infrastructure.

Salary not listed
On-siteML Engineering

About the role

Responsibilities

  • Define and enforce quality standards for training data
  • Build tooling and workflows to audit supplier-generated datasets, including sampling strategies, validation pipelines (rule-based and model-assisted), and feedback loops
  • Determine if and how human-in-the-loop review workflows can be used to optimize QA
  • Partner with data vendors to debug quality issues, provide actionable feedback, and improve their data generation processes
  • Continuously integrate QA learnings into infrastructure tools and data vendor portal to reduce anomalies, inconsistencies, and edge cases

Experience

  • Proficiency in Python, Docker, and Linux environments
  • Worked with large-scale datasets
  • Evidence of rapid learning and adaptability in technical environments (e.g., programming competitions)
  • Startup experience in early-stage technology companies with ability to work independently in fast-paced environments
  • Familiarity with current AI tools and LLM capabilities
  • Strong communication skills for remote collaboration across time zones

Strong candidates may also

  • Understand common failure modes in training data
  • Have experience building data validation pipelines and/or human-in-the-loop review systems
  • Be detail-oriented and able to spot subtle inconsistencies or edge cases in data
  • Be comfortable designing metrics, experiments, and QA processes, not just executing them

Skills

PythonDockerLinuxLLMsData ValidationLarge-Scale DatasetsValidation PipelinesHuman-In-The-LoopAI Tools

Similar roles

ML Engineering jobs
Cerebras Systems

CoDesign & NextGen Performance Engineer

Cerebras SystemsSunnyvale, CA

Characterize, analyze, and optimize performance of state-of-the-art AI models on Cerebras' wafer-scale hardware. Build performance models, optimize kernels and compilers, debug runtime behavior, and develop visualization tools to influence next-gen AI architecture.

Salary not listed
On-site3+ YOEML Engineering
OpenAI

Research Engineer, Privacy

OpenAISan Francisco, CA

Research Engineer on OpenAI's Privacy team designing and prototyping privacy-preserving ML algorithms like differential privacy and federated learning at scale. Requires hands-on PETs experience, fluency in PyTorch/JAX, and a track record implementing or publishing novel privacy work.

380k – 445k/yr
HybridML Engineering
Console

Research Engineer

ConsoleSan Francisco, CA

Research Engineer building self-improving AI agent systems at Console. Develop eval/optimization loops, fine-tune specialist models, and improve agent reasoning over enterprise context using production data to drive measurable gains in quality, latency, and reliability.

200k – 350k/yr
On-siteML Engineering
Notion

Software Engineer, AI Platform

NotionSan Francisco, CA +1

Build and scale the shared AI platform foundations at Notion, enabling fast and safe shipping of AI products. Requires experience with LLM/ML platforms, strong ownership, and comfort across backend, infrastructure, and product code.

180k – 201k/yr
Hybrid5+ YOEML Engineering
Liftoff

Machine Learning Engineer

LiftoffCalifornia

Machine Learning Engineer building statistical models, optimization systems, and experiments for mobile ad tech economics on the Revenue Engine team. Requires PhD in CS/ML/Economics and industry experience applying ML or economics at scale.

215k – 275k/yr
RemoteML Engineering