Head of AI Training Research
United StatesAI ResearchRemote8+ YOE
Summary
Lead applied AI research practice delivering client outcomes through benchmarking, data strategy, and RL environments. Drive revenue impact, scope engagements, and lead cross-functional teams of researchers and engineers.
About the role
Leadership & Commercial Accountability
- Lead and align a cross-functional pod of applied researchers, FDEs, and project leads around shared client outcome goals
- Own the research practice's contribution to revenue — including supporting pre-sales, scoping engagements, and ensuring delivery quality that drives retention and expansion
- Act as an executive sponsor on strategic accounts, providing research credibility and depth to client relationships
- Build a team culture that is rigorous, fast-moving, and relentlessly focused on client impact
Client Delivery & Applied Research
- Define the applied research frameworks, workflows, and quality standards used across all client engagements
- Ensure applied researchers are translating benchmarking, data, and RL environment work directly into client-specific training solutions
- Partner with project leads to scope engagements accurately, manage research risk, and hit delivery milestones
- Work with FDEs to ensure research outputs are deployable, integrated, and producing measurable model improvements in client environments
Benchmarking
- Oversee the development of benchmarking capabilities used to demonstrate value to clients — pre- and post-engagement performance comparisons, capability gap analyses, and regression tracking
- Ensure benchmark design is tied to client-defined success metrics, not just internal research goals
- Use benchmark outputs as a feedback loop to continuously improve delivery quality across engagements
OTS Data & Data Strategy
- Lead strategy around sourcing, filtering, and deploying off-the-shelf datasets in support of client training objectives
- Build repeatable frameworks for data quality assessment that can be applied efficiently across diverse client use cases
- Identify reusable data assets and pipelines across engagements to improve margins and delivery speed
RL Environment Building
- Oversee the development of RL environments that are purpose-built or adapted for client-specific task performance
- Ensure environments are reproducible and portable across client deployments
- Partner with FDEs and applied researchers to close the loop between environment design and real-world client outcomes
Requirements
- 8+ years in applied ML or AI research, with at least 3 years leading research or technical delivery teams in a client-facing or revenue-generating context
- Proven track record of translating research capabilities — benchmarking, data curation, or RL — into delivered client value
- Experience working across applied researcher, engineering, and project management functions; comfortable orchestrating cross-functional pods toward a shared outcome
- Strong commercial instincts — able to scope, price, and communicate research work in terms of client ROI
- Deep familiarity with LLM training pipelines, including fine-tuning, RLHF/RLAIF, and evaluation methodology
- Excellent executive communication skills; confident representing the research practice in client conversations and during pre-sales
Nice to Have
- Prior experience at an AI services firm, applied research consultancy, or enterprise AI product company
- Familiarity with data licensing, synthetic data generation, or contamination detection in the context of client data
- Experience building scalable delivery infrastructure (templates, tooling, benchmarks) that improves team output across engagements
Skills
Applied MLAI ResearchLLM TrainingFine-tuningRLHFRLAIFBenchmarkingData CurationReinforcement LearningEvaluation Methodology