# Data Scientist, Codex
**Company:** [OpenAI](https://hotfix.jobs/companies/openai)
**Location:** San Francisco, CA
**Salary:** $230K-$385K
**Experience:** 5+ years
**Skills:** SQL, Python, A/B Testing, Causal Inference, Product Metrics, Dashboards, NLP, LLMs, Code Models
**Posted:** 2025-09-30
> Data Scientist measures and accelerates product-market fit for AI developer tools by defining developer productivity metrics, running A/B tests on coding models and UX, and building dashboards. Requires 5+ years quantitative experience, SQL/Python fluency, and experiment design skills.
## Job Description
## Responsibilities
- Embed with the Codex product team to discover opportunities that improve developer outcomes and growth
- Design and interpret A/B tests and staged rollouts of new coding models and product features
- Define and operationalize metrics such as suggestion acceptance, edit distance, compile/test pass rates, task completion, latency, and session productivity
- Build dashboards and analyses that help the team self-serve answers to product questions (by language, framework, repo size, task type)
- Diagnose failure modes and partner with Research on targeted improvements (model quality signals, user feedback, evals)

## Requirements
- 5+ years in a quantitative role at a developer-facing or high-growth product
- Fluency in **SQL** and **Python**; comfort with experiment design and causal inference
- Experience defining product metrics tied to user value
- Ability to communicate clearly with PM, Eng, and Design—and to influence product direction

## Nice-to-Haves
- Strong programming background; ability to prototype, run simulations, and reason about code quality
- Familiarity with IDE/extension telemetry or developer tooling analytics
- Prior experience with **NLP**/**LLMs**, code models, or evaluations for generative coding
**Apply:** https://hotfix.jobs/jobs/data-scientist-codex-at-openai-d3d204f3-9871-4260-a3d6-c1da868f21de
**Canonical:** https://hotfix.jobs/jobs/data-scientist-codex-at-openai-d3d204f3-9871-4260-a3d6-c1da868f21de