Skip to content
Invisible TechInvisible TechUnited States

Head of AI Training Research

Lead applied AI research practice delivering client outcomes through benchmarking, data strategy, and RL environments. Drive revenue impact, scope engagements, and lead cross-functional teams of researchers and engineers.

Salary not listed
Remote8+ YOEAI Research

About the role

Leadership & Commercial Accountability

  • Lead and align a cross-functional pod of applied researchers, FDEs, and project leads around shared client outcome goals
  • Own the research practice's contribution to revenue — including supporting pre-sales, scoping engagements, and ensuring delivery quality that drives retention and expansion
  • Act as an executive sponsor on strategic accounts, providing research credibility and depth to client relationships
  • Build a team culture that is rigorous, fast-moving, and relentlessly focused on client impact

Client Delivery & Applied Research

  • Define the applied research frameworks, workflows, and quality standards used across all client engagements
  • Ensure applied researchers are translating benchmarking, data, and RL environment work directly into client-specific training solutions
  • Partner with project leads to scope engagements accurately, manage research risk, and hit delivery milestones
  • Work with FDEs to ensure research outputs are deployable, integrated, and producing measurable model improvements in client environments

Benchmarking

  • Oversee the development of benchmarking capabilities used to demonstrate value to clients — pre- and post-engagement performance comparisons, capability gap analyses, and regression tracking
  • Ensure benchmark design is tied to client-defined success metrics, not just internal research goals
  • Use benchmark outputs as a feedback loop to continuously improve delivery quality across engagements

OTS Data & Data Strategy

  • Lead strategy around sourcing, filtering, and deploying off-the-shelf datasets in support of client training objectives
  • Build repeatable frameworks for data quality assessment that can be applied efficiently across diverse client use cases
  • Identify reusable data assets and pipelines across engagements to improve margins and delivery speed

RL Environment Building

  • Oversee the development of RL environments that are purpose-built or adapted for client-specific task performance
  • Ensure environments are reproducible and portable across client deployments
  • Partner with FDEs and applied researchers to close the loop between environment design and real-world client outcomes

Requirements

  • 8+ years in applied ML or AI research, with at least 3 years leading research or technical delivery teams in a client-facing or revenue-generating context
  • Proven track record of translating research capabilities — benchmarking, data curation, or RL — into delivered client value
  • Experience working across applied researcher, engineering, and project management functions; comfortable orchestrating cross-functional pods toward a shared outcome
  • Strong commercial instincts — able to scope, price, and communicate research work in terms of client ROI
  • Deep familiarity with LLM training pipelines, including fine-tuning, RLHF/RLAIF, and evaluation methodology
  • Excellent executive communication skills; confident representing the research practice in client conversations and during pre-sales

Nice to Have

  • Prior experience at an AI services firm, applied research consultancy, or enterprise AI product company
  • Familiarity with data licensing, synthetic data generation, or contamination detection in the context of client data
  • Experience building scalable delivery infrastructure (templates, tooling, benchmarks) that improves team output across engagements

Skills

Applied MlAi ResearchLlm TrainingFine-TuningRLHFRlaifBenchmarkingData CurationReinforcement LearningEvaluation Methodology

Similar roles

AI Research jobs
Figma

Director, Research

FigmaSan Francisco, CA +1

Lead AI evaluation for Figma's AI-powered products. Define quality metrics, build human + automated eval frameworks (rubrics, golden datasets, LLM-as-judge), manage a small team, and deliver decision-ready insights to Product, Design, and Engineering stakeholders.

258k – 348k
Hybrid10+ YOEAI Research
Scale AI

Head of Policy & Security Research Lab

Scale AISan Francisco, CA +2

Lead Scale’s Policy Research Lab, setting strategy and managing research on AI safety, benchmarks, and frontier risk evaluations while collaborating with government institutes and academia. Requires 6+ years experience, strong technical/policy background, and proven team leadership.

198k – 247k
On-site6+ YOEAI Research
Protege

Director of Research, DataLab

ProtegeUnited States

Lead Protege's DataLab research organization, defining strategy for AI training data quality, evaluation systems, and marketplace optimization while managing researchers and partnering with Product, Engineering, and GTM.

Salary not listed
RemoteAI Research
Kepler

Head of AI Research

KeplerNew York, NY

Lead AI research defining the agenda for trustworthy agentic systems, memory, retrieval, and evaluation frameworks. PhD required with 5+ years focused on LLMs/agents and a strong publication record; work ships directly to production for high-stakes financial users.

400k – 700k
On-site5+ YOEAI Research
Upstart

Principal Applied Scientist

UpstartUnited States

As a Principal Applied Scientist, you will define the technical direction for offer optimization and conversion modeling systems, working across teams to integrate models and optimization systems. This role involves structuring ambiguous problems, designing solutions, and providing technical oversight to ensure a coherent long-term vision.

220k – 330k
Remote8+ YOEAI Research