Skip to content

Data Scientist, Behavior Evaluation

176k – 240kFoster City, CABoston, MAHybrid3+ YOE
Summary

Data Scientist on Behavior Evaluation team designing statistical frameworks and metrics to validate autonomous vehicle planner behavior on highways using simulation and fleet data. Requires 3-6+ years experience, strong Python/SQL skills, and expertise in experimental design and hypothesis testing.

About the role

Responsibilities

  • Design advanced experimental frameworks including statistical models, hypothesis testing, and quasi-experimental designs (synthetic controls, matching) to validate highway planner behavior in simulation and shadow-mode deployments
  • Model tail risks and rare events using Surrogate Safety Measures (TTC, PET) to predict low-frequency, high-severity edge cases
  • Architect scenario-based metrics and own behavioral KPIs, utilizing data stratification to analyze complex driving scenarios while identifying statistical anomalies
  • Surface statistical edge cases through data mining and advanced statistical techniques to isolate low-frequency, high-severity events and systemic engineering debt
  • Drive cross-functional alignment by translating complex statistical findings into actionable technical recommendations for Autonomy Software Engineers, Safety Systems, and Product teams

Requirements

  • Bachelor’s or Master’s degree in Statistics, Mathematics, Data Science, Operations Research, or related quantitative field with strong statistical focus
  • 3–6+ years of professional experience as a Data Scientist or Quantitative Engineer
  • Deep understanding of hypothesis testing, experimental design, regression analysis, non-parametric/resampling methods (bootstrapping, permutation tests), and time-series analysis for autocorrelated data
  • High proficiency in Python (Pandas, NumPy, SciPy, scikit-learn) and ability to write complex, optimized SQL queries for massive distributed databases
  • Exceptional ability to articulate complex mathematical methodologies and statistical results to cross-functional engineering partners

Nice-to-Haves

  • Experience analyzing spatial-temporal data, sensor logs, or vehicle telemetry from robotics, autonomous vehicles, or aviation systems
  • Familiarity with validating software systems using simulation platforms at scale
  • Experience with workflow orchestration tools (Airflow) and data visualization layers (Superset)
Skills
PythonPandasNumPySciPyscikit-learnSQLHypothesis TestingExperimental DesignRegression AnalysisTime Series Analysis
Similar roles at this salary range
All Data Science jobs →
Fetch

Senior Data Scientist

Lead high-impact data science initiatives at Fetch, designing predictive and causal models, building experimentation frameworks, and partnering cross-functionally to drive personalization, retention, and monetization strategies.

184k – 216kUnited StatesData ScienceRemote8+ YOESQLdbt
Customer.io

Senior Manager, Data Science & Analytics

Lead and grow a data science & analytics team that partners with Product, Marketing, Sales, and CX to drive forecasting, experimentation, behavioral analytics, and measurement at a B2B SaaS company.

170k – 200kUnited StatesData ScienceRemote7+ YOESQLdbt
Lyft

Senior Data Scientist, Causal Inference

Lead causal inference and marketing mix modeling efforts to measure and optimize marketing investments. Requires 4+ years experience, advanced degree, and expertise in Python, SQL, and production environments.

148k – 185kNew York, NYData ScienceHybrid4+ YOESQLPython
Lyft

Senior Data Scientist, Causal Inference

Lead causal inference and marketing mix modeling efforts to measure and optimize marketing investments. Requires 4+ years experience, advanced degree, and expertise in Python, SQL, and statistical pipelines.

148k – 185kSan Francisco, CAData ScienceHybrid4+ YOESQLPython
Pinterest

Staff Data Scientist, Ads Product

Staff Data Scientist driving ads product strategy and data-driven decision-making at Pinterest. Partners with product, engineering, and finance teams to translate business questions into analytical solutions and maintain data quality.

165k – 339kSan Francisco, CAData ScienceRemote8+ YOESQLPython