Skip to content
Neon HealthNeon HealthSan Francisco, CA

AI Quality Operator

Reviews AI agent outputs like phone call transcripts and recordings to identify issues, label them, and suggest improvements for better performance in healthcare automation workflows. Requires detail-orientation, speed, rigor, and comfort with technical systems in fast-paced environments.

59k – 136k
On-siteEntry levelQA Engineering

About the role

Responsibilities

  • Review transcripts and recordings of AI agents' phone calls
  • Understand issues that arose during calls
  • Label and document those issues
  • Provide suggested guidance on how to improve AI agents going forward

Requirements

  • Detail-oriented with outstanding attention to detail
  • Ability to execute with speed and urgency
  • Rigorous: investigate and deeply understand problems, identify root causes
  • Growth mindset: curious, experimental, adaptable
  • Experience operating with excellence in fast-paced, dynamic environments
  • Early career with demonstrated talent, hustle, and creativity
  • Comfortable with technical systems

Skills

AI AgentsConversational AITranscript ReviewCall RecordingsQuality AssuranceIssue LabelingRoot Cause AnalysisPhone Call AnalysisAi Output ReviewAi Improvement Suggestions

Similar roles

QA Engineering jobs
Prompt Health

QA Analyst

Prompt HealthUnited States

QA Analyst responsible for manual testing of healthcare software, including AI-enabled features. Focuses on functional, regression, and acceptance testing while leveraging AI tools to improve QA efficiency.

65k – 85k
Remote1+ YOEQA Engineering
Nuro

Software Operations Specialist

NuroMountain View, CA

Performs quality control on data annotations and tests internal tools for robotics/autonomy software, reproducing bugs and documenting issues to improve reliability. Requires 1-3 years QA/testing experience, meticulous attention to detail, and remote async work capability.

73k – 93k
Remote1+ YOEQA Engineering
Axle

Quality Assurance & Support Engineer

AxleRockville, MD

Quality Assurance & Support Engineer owning end-to-end product quality for a Node.js/Angular Identity Management system. Design and maintain automated (Playwright) and manual tests, leverage AI/LLM testing techniques, triage and resolve end-user support issues, and collaborate with the development team in an Agile environment.

80k – 95k
On-site2+ YOEQA Engineering
Shield AI

Engineer II, Systems Test (R5038)

Shield AIWashington, DC

Engineer II focused on simulation-driven testing, automation, and quality assurance for Shield AI's Hivemind autonomy software in simulated and real-world environments. Requires 2+ years experience, Python proficiency, robotics background, and ability to obtain SECRET clearance.

89k – 130k
On-site2+ YOEQA Engineering
Applied Intuition

Triage Engineer

Applied IntuitionSunnyvale, CA

Triage Engineer analyzes test data for AV systems, triages drive failures by reproducing in simulation, and collaborates with dev teams for rapid feedback. Requires 2+ years in safety-critical systems like autonomous vehicles and proficiency in Linux/Python scripting.

90k – 150k
On-site2+ YOEQA Engineering