Performs quality control on data annotations and tests internal tools for robotics/autonomy software, reproducing bugs and documenting issues to improve reliability. Requires 1-3 years QA/testing experience, meticulous attention to detail, and remote async work capability.
73k – 93k
Remote1+ YOEQA Engineering
About the role
Responsibilities
Quality Review of Data Annotation
Review annotated datasets and labeling outputs for quality and consistency across robotics and autonomy workflows
Apply defined QC criteria and rubrics to evaluate outputs as pass, fail, or needs review
Document specific defect types per task — incorrect output, regression, edge-case failure, data inconsistency, tool behavior deviation
Maintain a clean review log for every item assessed — no undocumented assessments
Tool Testing & Bug Reproduction
Test internal tools across standard workflows and exception scenarios as directed by the Operations Lead
Reproduce reported bugs reliably and validate fixes with clear supporting documentation — steps, inputs, expected vs. actual behavior
Confirm test parameters and scope before each cycle and flag discrepancies
Track test coverage across tools, workflows, and edge cases
Reporting
Submit completed QC and testing logs on the agreed cadence
Flag urgent or high-severity defects same-day — do not wait for the regular report
Write clear, specific defect notes — exact descriptions of what failed, reproduction steps, and impact, not vague feedback
Escalation & Process Improvement
Escalate any case where the rubric or test plan is ambiguous or does not cover the scenario — do not guess
Flag patterns you notice across multiple items — recurring defects, systemic issues, documentation gaps
Help improve QC processes, testing methods, and internal documentation through structured feedback to the Operations Lead
Collaborate with operations and engineering teams to communicate findings and support prioritization — all formal feedback routes through the Operations Lead
Requirements
1–3 years of experience in QA, software testing, operations, content review, or a closely related field
Demonstrated ability to apply rubrics or evaluation criteria consistently across high volumes of work
High attention to detail and strong problem-solving ability — you catch things others miss and document them precisely
Excellent written and verbal communication — defect notes are specific, clear, and actionable
Comfortable learning new tools and working across technical systems
Able to manage multiple tasks independently in a fast-paced, remote async environment
Reliable and consistent — this role requires showing up to a regular cadence without prompting
Nice-to-Haves
Experience with mapping, 3D tools, or visual software
Familiarity with U.S. roadways and driving behavior
Experience reviewing outputs across multiple modalities — text, image, sensor data, video
Exposure to robotics, autonomy, or ML training data production environments
Quality Assurance & Support Engineer owning end-to-end product quality for a Node.js/Angular Identity Management system. Design and maintain automated (Playwright) and manual tests, leverage AI/LLM testing techniques, triage and resolve end-user support issues, and collaborate with the development team in an Agile environment.
80k – 95k
On-site2+ YOEQA Engineering
QA Analyst
Prompt HealthUnited States
QA Analyst responsible for manual testing of healthcare software, including AI-enabled features. Focuses on functional, regression, and acceptance testing while leveraging AI tools to improve QA efficiency.
65k – 85k
Remote1+ YOEQA Engineering
AI Quality Operator
Neon HealthSan Francisco, CA
Reviews AI agent outputs like phone call transcripts and recordings to identify issues, label them, and suggest improvements for better performance in healthcare automation workflows. Requires detail-orientation, speed, rigor, and comfort with technical systems in fast-paced environments.
59k – 136k
On-siteEntry levelQA Engineering
Engineer II, Systems Test (R5038)
Shield AIWashington, DC
Engineer II focused on simulation-driven testing, automation, and quality assurance for Shield AI's Hivemind autonomy software in simulated and real-world environments. Requires 2+ years experience, Python proficiency, robotics background, and ability to obtain SECRET clearance.
89k – 130k
On-site2+ YOEQA Engineering
Triage Engineer
Applied IntuitionSunnyvale, CA
Triage Engineer analyzes test data for AV systems, triages drive failures by reproducing in simulation, and collaborates with dev teams for rapid feedback. Requires 2+ years in safety-critical systems like autonomous vehicles and proficiency in Linux/Python scripting.