What you will do
- Own causal inference and experimentation standards across Headway. Define the canonical approaches, guardrails, documentation, and review mechanisms for experiments and quasi-experiments, including when and how to use Bayesian methods.
- Build the confidence ladder for company knowledge. Create a clear, shared framework that maps findings to levels of confidence (for example 1–10), where lower levels reflect correlation and early directional evidence, mid levels reflect increasingly credible causal inference, and the highest levels reflect stable, repeatable, decision-grade truths. Operationalize it so it shows up in artifacts teams actually use: PRDs, launch reviews, growth planning, quarterly business reviews, and postmortems.
- Design the learning strategy for our hardest questions. Lead the approach for ambiguous, high impact domains like provider activation and retention, payer economics and policies, patient conversion and engagement, and marketplace dynamics. Recommend the right combination of randomized experiments, stepped rollouts, geo tests, natural experiments, and observational designs.
- Raise the organization’s statistical maturity. Introduce and standardize Bayesian experimentation practices where it improves speed and decision quality (priors, posterior interpretation, sequential decision rules, credible intervals, expected value framing). Build training, playbooks, and reusable tooling.
- Be the escalation point for difficult measurement problems. Tackle issues like interference and spillovers, network effects, selection bias, noncompliance, measurement error, multiple comparisons, seasonality, and Simpson’s paradox showing up in real life and causing confusion.
- Partner with Data Platform and Engineering to make rigor scalable. Ensure experimentation and inference are supported by instrumentation, logging, metric definitions, semantic layers, and monitoring. Help define the minimal foundations required for trustworthy learning.
- Build a culture of clear claims. Establish norms for separating facts, estimates, assumptions, and uncertainties. Make it easy for teams to say “we do not know yet” without losing momentum, and easy for leaders to understand what is safe to act on.
- Mentor and set the bar. Coach other data scientists and analytics leaders. Create review standards for causal work, support hiring for methodological depth, and represent Headway’s measurement philosophy internally and externally when appropriate.
What will make you successful
- 12+ years of experience applying causal inference, experimentation, and advanced statistics to real-world product, growth, or operational decisions (or equivalent depth demonstrated through scope and outcomes).
- Deep expertise in causal inference across randomized and observational settings, including practical strategy for when clean experiments are not possible.
- Deep expertise in Bayesian methods for experimentation and decision-making, and strong judgment about when Bayesian approaches outperform frequentist defaults and when they do not.
- Strong SQL and strong proficiency in Python or R, including building reusable analysis tools and improving team workflows.
- Track record of setting org-wide standards that materially improved decision quality and execution velocity.
- Executive-level communication and influence: you can drive alignment across Product, Growth, Ops, Finance, and Engineering.
- Comfort operating in ambiguity, and the ability to turn it into crisp frameworks, clear recommendations, and measurable outcomes.
- Motivation for our mission: improving access and affordability in mental healthcare.
Nice to have
- Experience in marketplaces, healthcare, insurance, or other regulated and complex incentive systems.
- Experience with experimentation under interference and network effects.
- Experience building experimentation platforms, analysis libraries, or statistical tooling used broadly across an organization.
- Familiarity with causal graphs, uplift modeling, and decision theory framing (expected value, value of information).
Compensation and Benefits
The expected base pay range for this position is $249,600 - $312,000, based on a variety of factors including qualifications, experience, and geographic location. In addition to base salary, this role may be eligible for an equity grant, depending on the position and level.
Benefits offered include:
- Equity compensation
- Medical, Dental, and Vision coverage
- HSA / FSA
- 401K
- Work-from-Home Stipend
- Therapy Reimbursement
- 16-week parental leave for eligible employees
- Carrot Fertility annual reimbursement and membership
- 13 paid holidays each year as well as a Holiday Break during the week between December 25th and December 31st
- Flexible PTO
- Employee Assistance Program (EAP)
- Training and professional development