Skip to content
OpenAIOpenAIBellevue, WA

Data Scientist, Core Experimentation

Leads evolution of OpenAI's core experimentation platform, driving statistical strategy, designing methodologies, and building scalable Python/Spark pipelines to ensure reliable, trustworthy experiments at massive scale. Requires deep stats expertise, causal inference, and production experimentation experience.

293k – 325k/yr
HybridData Science

About the role

Responsibilities

  • Drive the statistical direction and technical strategy for OpenAI’s experimentation platform
  • Design and improve experimentation methodologies used across product and research teams
  • Build pragmatic solutions to real-world experimentation challenges, balancing rigor with operational simplicity
  • Improve the reliability and trustworthiness of experiment results, including detection and prevention of bias, logging issues, and data quality failures
  • Develop scalable analytical systems and pipelines in Python and distributed compute environments
  • Partner with engineers and product teams to improve experiment design, metric quality, and decision-making practices
  • Lead investigations into complex experimentation anomalies and measurement failures
  • Establish best practices for experimentation governance, interpretation, and statistical correctness
  • Mentor other data scientists and raise the overall technical bar for experimentation and causal inference

Requirements

  • Experience building, scaling, or operating experimentation platforms at a large technology company
  • Deep expertise in statistics, causal inference, and online experimentation methodology
  • Strong understanding of practical experimentation challenges in production systems
  • Experience with areas such as variance reduction, CUPED, sequential testing, SRM detection, metric design, or heterogeneous effects
  • Strong coding and systems skills in Python and large-scale data processing frameworks (e.g. Spark)
  • Experience designing analytical data models and scalable experimentation pipelines
  • Ability to communicate complex statistical concepts clearly to technical and non-technical audiences
  • Track record of influencing technical strategy through hands-on technical leadership

Nice-to-Haves

  • Experience in large-scale product experimentation, ML experimentation, ranking systems, marketplace systems, or similar high-scale experimentation domains

Compensation

$293K - $325K USD

Skills

PythonSparkStatisticsCausal InferenceOnline ExperimentationCupedSequential TestingSrm DetectionVariance ReductionMetric Design

Similar roles

Data Science jobs
Anthropic

People Research Scientist

AnthropicNew York, NY +2

Lead rigorous research on employee experience, manager effectiveness, and organizational health at Anthropic. Design studies, analyze surveys with psychometrics, build frameworks, and translate findings into people strategy using SQL, Python/R, and advanced methods. Requires advanced degree and 5+ years quantitative research experience.

285k – 380k/yr
Hybrid5+ YOEData Science
Anthropic

Data Scientist, GTM

AnthropicNew York, NY +1

Drive data-informed decisions across Anthropic's commercial customer lifecycle by owning GTM metrics, causal inference experiments, statistical modeling, and actionable insights for acquisition, activation, expansion, and retention of a consumption-based AI platform.

285k – 380k/yr
Hybrid5+ YOEData Science
Anthropic

Data Scientist, Supply

AnthropicSan Francisco, CA +1

Data Scientist focused on compute allocation and causal inference to optimize AI infrastructure decisions and connect supply choices to user outcomes. Requires strong Python/SQL skills and experience with constrained optimization and production systems.

285k – 460k/yr
On-site5+ YOEData Science
OpenAI

Economist

OpenAISan Francisco, CA

Economist (up to 5 years post-PhD) conducting empirical research on AI’s economic impacts using large datasets, causal inference, and structural modeling. Requires PhD and strong econometrics/SQL/Python skills.

266k – 385k/yr
Hybrid3+ YOEData Science
Anthropic

Research Economist, Economic Research

AnthropicSan Francisco, CA

Measures AI's economic impacts through the Anthropic Economic Index using econometrics, ML, and novel data. Conducts empirical research on labor markets, productivity, inequality; requires PhD in Economics and strong empirical track record.

320k – 405k/yr
HybridData Science