Skip to content
hudhudSan Francisco, CA

Research Engineer, Synthetic Data

Build synthetic data pipelines and tasks to train frontier AI agents. Requires Python, Docker, Linux, and experience creating realistic, scalable synthetic training data for models and evals.

Salary not listed
On-siteML Engineering

About the role

Responsibilities

  • Work with subject-matter experts to create synthetic tasks for training AI agents across a range of professional and technical domains
  • Design synthetic task generation methods that produce diverse, realistic, and learnable tasks
  • Build systems and tooling to mutate, validate, and improve synthetic tasks
  • Analyze model and agent performance on synthetic tasks to understand what the tasks are teaching and where they fail
  • Develop metrics to quantify and understand synthetic task diversity, realism, learnability, etc.

Requirements

  • Proficiency in Python, Docker, and Linux environments
  • Experience with synthetic data research methods
  • Strong understanding of what “good synthetic data” means and its limitations
  • Built synthetic data pipelines end-to-end without a fully prescribed roadmap
  • Experience working on environments, evals, and benchmarks

Nice-to-Haves

  • Detail-oriented and able to spot subtle inconsistencies or edge cases in synthetic data
  • Able to reason from first principles about task design, scoring, and failure modes
  • Thrive in unstructured problem spaces
  • Early-stage startup experience with ability to work independently in fast-paced environments
  • Strong communication skills for remote collaboration across time zones

Skills

PythonDockerLinuxSynthetic DataAI AgentsEvalsBenchmarks

Similar roles

ML Engineering jobs
Cerebras Systems

CoDesign & NextGen Performance Engineer

Cerebras SystemsSunnyvale, CA

Characterize, analyze, and optimize performance of state-of-the-art AI models on Cerebras' wafer-scale hardware. Build performance models, optimize kernels and compilers, debug runtime behavior, and develop visualization tools to influence next-gen AI architecture.

Salary not listed
On-site3+ YOEML Engineering
OpenAI

Research Engineer, Privacy

OpenAISan Francisco, CA

Research Engineer on OpenAI's Privacy team designing and prototyping privacy-preserving ML algorithms like differential privacy and federated learning at scale. Requires hands-on PETs experience, fluency in PyTorch/JAX, and a track record implementing or publishing novel privacy work.

380k – 445k
HybridML Engineering
Console

Research Engineer

ConsoleSan Francisco, CA

Research Engineer building self-improving AI agent systems at Console. Develop eval/optimization loops, fine-tune specialist models, and improve agent reasoning over enterprise context using production data to drive measurable gains in quality, latency, and reliability.

200k – 350k
On-siteML Engineering
Notion

Software Engineer, AI Platform

NotionSan Francisco, CA +1

Build and scale the shared AI platform foundations at Notion, enabling fast and safe shipping of AI products. Requires experience with LLM/ML platforms, strong ownership, and comfort across backend, infrastructure, and product code.

180k – 201k
Hybrid5+ YOEML Engineering
Liftoff

Machine Learning Engineer

LiftoffCalifornia

Machine Learning Engineer building statistical models, optimization systems, and experiments for mobile ad tech economics on the Revenue Engine team. Requires PhD in CS/ML/Economics and industry experience applying ML or economics at scale.

215k – 275k
RemoteML Engineering