# Senior Test Engineer - Metrics Quality

**Company:** [Avride](https://hotfix.jobs/companies/avride)
**Location:** Austin, TX
**Role:** QA Engineering
**Experience:** 6+ years
**Skills:** Python, SQL, Statistics, ClickHouse, A/B Testing, Machine Learning, LLMs, Regression Testing, Test Data Generation, Data Analysis
**Posted:** 2026-09-01

> Own the quality, acceptance, and release testing of analytical metrics used to evaluate autonomous-driving software. The role requires 6+ years in software testing, strong Python and SQL, statistical literacy, and experience with data-heavy systems.

## Job Description

## Responsibilities
- Own acceptance and release qualification for new and changed metrics used in autonomous-driving software decisions.
- Define and maintain comprehensive metric case spaces, including situations where metrics should remain silent.
- Identify silent failures and assess how often metrics are incorrect or fail to report.
- Review metric implementations against expected cases to find unhandled scenarios.
- Build or source test data for required metric situations and improve data-generation workflows.
- Present findings to metric owners with concrete examples, impact, and scale.
- Evaluate whether metrics reveal aggregate degradation across recorded-scene datasets.
- Run and maintain regression testing that detects changes in metric meaning and behavior, while improving release efficiency.

## Requirements
- 6+ years of software testing or test engineering experience, with depth in data-heavy or analytical systems.
- Strong Python and SQL skills, including analysis scripts and independent reference computations.
- Statistical literacy, including distributions, variance, sample size, aggregation pitfalls, and distinguishing noise from meaningful differences.
- Product-oriented approach to determining what metrics are intended to measure and support.
- Ability to communicate and defend findings with evidence.
- Fluent use of LLMs for analysis, test-data generation, unfamiliar-code review, and reasoning validation.
- Clear written English.

## Nice to Have
- Experience with autonomous vehicles, robotics, or machine-learning system evaluation.
- ClickHouse or a similar analytical database.
- Experience testing evaluation pipelines or A/B testing infrastructure.
- Experience designing human-reviewer annotation tasks and measuring reviewer agreement.
- Knowledge of US road rules and driver behavior.

## Similar jobs

- [Systems Integration and Test Engineer](https://hotfix.jobs/jobs/54bfb9b3-dd37-4e82-ab75-89da1c7d6adc) - Skydio - San Mateo, CA - $196k – $270k/yr
- [Lead Test Engineer AV Safety Assurance](https://hotfix.jobs/jobs/3c137bea-8b11-460c-a04f-3ab804e33533) - Avride - Austin, TX
- [Senior Software Engineer, Payments Quality](https://hotfix.jobs/jobs/241a13d3-fa5d-4595-b0fd-5d45056565e0) - VGS - San Francisco, CA - $170k – $215k/yr
- [Senior Validation Engineer](https://hotfix.jobs/jobs/ef31c44e-628c-4e87-8b0a-e0fdb341c624) - Applied Intuition - Sunnyvale, CA - $120k – $190k/yr
- [Senior Quality Engineer, Data Platform](https://hotfix.jobs/jobs/3fd59e63-dfb2-44b1-ab2a-5fe732042d6f) - FloQast - San Jose, CA

**Apply:** https://hotfix.jobs/jobs/88774e71-4af5-40ab-9892-23dce742c246
**Canonical:** https://hotfix.jobs/jobs/88774e71-4af5-40ab-9892-23dce742c246