Lead Test Engineer - Scenario Coverage & Evaluation Data Sets
Leads end-to-end evaluation dataset and scenario coverage strategy for an autonomous-driving stack, using data mining, simulation, field capture, and risk-based metrics. Requires 8+ years in test engineering, full-system strategy ownership, hands-on SQL/Python, and strong cross-functional communication.
About the job
Responsibilities
- Own the autonomous-driving evaluation dataset, including its contents, gaps, and the quality claims it supports.
- Maintain the coverage model, scenario taxonomy, and ODD parameter space as the technology and operating environment evolve.
- Close gaps between abstract scenarios and real scenes through data mining, simulation, or field capture.
- Set data-mining priorities for QA engineers, review results, and establish a recurring feedback process.
- Act as the internal customer for mining tools; use them directly and translate findings into requirements for development and analytics teams.
- Research coverage, edge-case curation, and data-selection practices from autonomous-vehicle programs, research groups, and vendors.
- Coordinate with labeling and analytics teams to establish priorities, metrics, and actionable feedback.
- Report coverage, readiness, confidence, and blind spots to support release decisions.
- Lead through process and existing QA resources, with the opportunity to build a team as scope expands.
Requirements
- 8+ years in software testing or test engineering, including 2+ years owning full-system test strategy.
- Experience with equivalence classes, parameter spaces, risk-based prioritization, and dataset sufficiency.
- Hands-on SQL and Python for extracting, joining, and validating metrics datasets.
- Practical use of LLMs for log search, triage, scenario generation, report drafting, and analysis scripting.
- Strong written communication for engineering and safety audiences.
- Ability to reason precisely about US road rules and real-world driver behavior, or learn them quickly.
- Authorized to work in the United States.
- Onsite work at the Austin headquarters; remote work is not available.
Nice to Have
- Experience hiring QA engineers.
- Experience in autonomous vehicles, robotics, ADAS, or another safety-critical domain.
- Familiarity with ODD taxonomy (ISO 34503), scenario-based safety evaluation (ISO 34501/ISO 34502), and SOTIF (ISO 21448).
- Experience with data mining, active learning, or data-selection loops over large sensor or log datasets.
- Experience specifying internal tooling with platform teams.
- Familiarity with vehicle dynamics or LiDAR, radar, and camera sensor modalities.
Compensation and Benefits
- The employer does not offer relocation or sponsorship.
Skills
Software Testing, Test Engineering, SQL, Python, LLMs, Data Mining, Active Learning, Odd Taxonomy, Iso 34503, Iso 34501, Iso 34502, Sotif, Iso 21448, Lidar, Radar
Similar jobs
QA Engineering jobsOwn systems requirements, architecture, integration, verification, reliability analysis, and failure resolution for autonomous flying robots. The role requires 6+ years of electromechanical systems experience, strong cross-domain testing skills, and proficiency in Python and SQL.
Leads safety testing and evidence practices for autonomous-vehicle QA, including gates, acceptance criteria, reporting, hazard-to-test traceability, and release decisions. Requires 7+ years in testing, verification, or validation and experience in a safety-critical domain.
Senior software engineer responsible for building automated quality strategies, high-concurrency performance tests, and emulators for mission-critical payment systems. The role requires 5+ years of quality engineering experience and hands-on expertise with automation, cloud-native CI/CD, distributed systems, and observability.
The Senior Validation Engineer develops and executes automotive system and integration tests using HIL benches, vehicles, and automated Python tooling. The role requires a master’s degree in an engineering discipline and at least one year of automotive test engineering experience.
Senior Quality Engineer responsible for automating and validating data pipelines, APIs, backend services, and financial-data workflows. Requires 5+ years of QA automation experience, strong JavaScript/TypeScript, Python, SQL, cloud data warehouse, and ETL/ELT expertise.