Skip to content
ProtegeProtegeUnited States

Director of Research, DataLab

Lead Protege's DataLab research organization, defining strategy for AI training data quality, evaluation systems, and marketplace optimization while managing researchers and partnering with Product, Engineering, and GTM.

Salary not listed
RemoteAI Research

About the role

Responsibilities

  • Define and lead the research strategy for Protege's DataLab, aligning experimentation with company priorities and product direction
  • Partner closely with Product, Engineering, and GTM teams to identify high-value research opportunities tied to AI data quality, evaluation, and marketplace performance
  • Design and oversee experiments that evaluate dataset quality, model performance, synthetic data workflows, and privacy-preserving methodologies
  • Build scalable systems for benchmarking, labeling quality analysis, and training data evaluation across multiple AI modalities
  • Serve as a customer-facing research partner to GTM, representing DataLab in sales, technical discovery, delivery, and customer strategy conversations
  • Translate ambiguous technical questions into clear research frameworks, measurable hypotheses, and actionable recommendations
  • Publish internal research findings that directly influence product decisions, customer strategy, and platform capabilities
  • Lead, manage, and scale a high-performing team of researchers and data scientists, driving execution, technical excellence, and career development
  • Establish operational rigor around experimentation, reproducibility, and research documentation
  • Represent Protege externally through technical conversations with customers, partners, and the broader AI ecosystem
  • Stay at the forefront of advancements in foundation models, evaluation methodologies, data infrastructure, and AI alignment research

Requirements

  • Led impactful research initiatives in AI, machine learning, data infrastructure, or applied research environments where outcomes influenced product or business strategy
  • Built and managed high-performing research teams that operated with autonomy, technical rigor, and fast execution cycles
  • Experience partnering directly with customers, GTM teams, or external stakeholders in applied technical settings
  • Developed frameworks for evaluating model performance, dataset quality, synthetic data, or large-scale experimentation systems
  • Experience operating in ambiguous, fast-moving environments where priorities evolved quickly
  • Strong ability to communicate complex technical findings to both technical and non-technical audiences
  • Demonstrated ownership of cross-functional initiatives spanning research, engineering, product, and go-to-market teams
  • Track record of translating research into practical systems, tools, or customer-facing impact
  • Experience working with modern AI systems, foundation models, LLM evaluation workflows, or privacy-centric data methodologies
  • High judgment, strong prioritization skills, and comfort making decisions with incomplete information

Skills

Ai ResearchMachine LearningLlm EvaluationDataset Quality EvaluationSynthetic DataExperimentation FrameworksResearch StrategyTeam LeadershipFoundation ModelsPrivacy-Preserving Methodologies

Similar roles

AI Research jobs
Figma

Director, Research

FigmaSan Francisco, CA +1

Lead AI evaluation for Figma's AI-powered products. Define quality metrics, build human + automated eval frameworks (rubrics, golden datasets, LLM-as-judge), manage a small team, and deliver decision-ready insights to Product, Design, and Engineering stakeholders.

258k – 348k
Hybrid10+ YOEAI Research
Invisible Tech

Head of AI Training Research

Invisible TechUnited States

Lead applied AI research practice delivering client outcomes through benchmarking, data strategy, and RL environments. Drive revenue impact, scope engagements, and lead cross-functional teams of researchers and engineers.

Salary not listed
Remote8+ YOEAI Research
Scale AI

Head of Policy & Security Research Lab

Scale AISan Francisco, CA +2

Lead Scale’s Policy Research Lab, setting strategy and managing research on AI safety, benchmarks, and frontier risk evaluations while collaborating with government institutes and academia. Requires 6+ years experience, strong technical/policy background, and proven team leadership.

198k – 247k
On-site6+ YOEAI Research
Kepler

Head of AI Research

KeplerNew York, NY

Lead AI research defining the agenda for trustworthy agentic systems, memory, retrieval, and evaluation frameworks. PhD required with 5+ years focused on LLMs/agents and a strong publication record; work ships directly to production for high-stakes financial users.

400k – 700k
On-site5+ YOEAI Research
Upstart

Principal Applied Scientist

UpstartUnited States

As a Principal Applied Scientist, you will define the technical direction for offer optimization and conversion modeling systems, working across teams to integrate models and optimization systems. This role involves structuring ambiguous problems, designing solutions, and providing technical oversight to ensure a coherent long-term vision.

220k – 330k
Remote8+ YOEAI Research