Learning Scientist
Designs AI-native teaching methods and establishes rigorous measurement of skill gain, retention, and transfer. The role requires deep learning-science knowledge, strong experimental and statistical skills, human-subjects research experience, and technical fluency with Python or R.
About the job
Responsibilities
- Invent and prototype AI-native teaching methods with engineers and integrate them into the product.
- Design the measurement framework for skill gain, retention, and transfer, including product instrumentation.
- Run well-designed studies with real learners, from short pilots to longitudinal cohorts.
- Build trustworthy performance assessments and rubrics, treating validity and reliability as engineering requirements.
- Establish an evidence-based standard for pedagogical decisions across the company.
- Partner directly with the founding team to guide product and instructional decisions with research findings.
Requirements
- Deep knowledge of learning science and research on retrieval, spacing, feedback, transfer, and expertise development.
- Strong experimental-design and statistical skills, including study power and signal-versus-noise evaluation.
- Human-subjects research experience in laboratory or field settings.
- Technical fluency with Python or R and ability to collaborate with engineers on instrumentation.
- Excellent communication skills for making evidence actionable to non-specialists.
Nice-to-haves
- PhD in learning sciences, cognitive psychology, education, or a related field, or equivalent research experience.
- Experience with intelligent tutoring systems, adaptive learning, or AI-based instruction.
- Psychometrics and assessment-validity experience, including IRT, rubric calibration, and rater reliability.
- Experience measuring learning in adult professional or workplace contexts.
Skills
Learning Science, Experimental Design, Statistics, Python, R, Human Subjects Research, Psychometrics, Assessment Validity, Item Response Theory, Rubric Calibration, Rater Reliability, Intelligent Tutoring Systems, Adaptive Learning, Artificial Intelligence
Similar jobs
AI Research jobs
Improbable
Remote
Conduct applied research on AI agents, designing experiments and evaluation systems to improve reliability, context retention, and multi-step task completion. The role requires strong AI/ML research, engineering, experimental design, and communication skills.
Anthropic
San Francisco, CA
Research Engineer building large-scale AI capability evaluations, telemetry, data pipelines, and analysis tools for Anthropic’s Takeoff Intel team. The role requires hands-on large language model experimentation, rapid prototyping, data expertise, and strong research collaboration.
Sardine
United States
Conduct applied research on foundation models for fraud detection using large-scale behavioral and financial-risk data. The role spans experimentation, evaluation, production deployment, and cross-functional work on model governance, requiring 4+ years of applied ML experience and strong Python and SQL skills.
OpenAI
San Francisco, CA
Researcher or engineer focused on designing, evaluating, and productionizing oversight systems and safety mitigations for autonomous AI agents. The role requires strong systems or security reasoning, threat-modeling ability, and experience building practical evaluations and controls.
OpenAI
San Francisco, CA
Researcher focused on training and evaluating frontier AI agents, mining incidents, and building scalable safety measurement systems. The role requires strong research or ML engineering execution, quantitative judgment, and the ability to own ambiguous projects end to end.