# Quality Control Lead

**Company:** [AfterQuery](https://hotfix.jobs/companies/afterquery)
**Location:** San Francisco, CA
**Role:** QA Engineering
**Salary:** $150k – $275k/yr
**Experience:** 3+ years
**Skills:** Quality Control, Quality Assurance, Python, Machine Learning, Data Science, Software Engineering, RLHF, Data Annotation, Dataset Evaluation, Debugging, Kpi Reporting, Claude Code
**Posted:** 2026-08-31

> Leads final quality review for technical and AI training datasets, improves QC automation and processes, and reports quality metrics to leadership. Requires 3+ years in a technical role, programming proficiency, rigorous evaluation skills, and experience leading QA/QC functions.

## Job Description

## Responsibilities
- Own the final quality checkpoint before datasets are delivered or published.
- Audit code, technical data, reasoning data, and knowledge-work data for correctness, clarity, structure, and adherence to specifications.
- Work with infrastructure engineers to automate and improve quality-control workflows.
- Partner with data delivery teams to identify systemic quality issues, provide feedback for contributor training, and prevent recurrence.
- Own quality metrics and KPIs, including error rates, root causes, and improvement trends, and report them to company leadership.
- Support company-wide initiatives involving building, analysis, coordination, and execution.

## Requirements
- 3+ years of experience in a technical role such as software engineering, data science, or machine learning engineering.
- Hands-on proficiency in at least one modern programming language.
- Ability to review, debug, and evaluate code, technical data, and knowledge-work data for correctness, structure, and quality.
- Experience building or leading a quality assurance or quality control function for a technical or data-centric product.
- Exceptional attention to detail and sound judgment when evaluating ambiguous or contested technical content.
- Strong leadership and communication skills, including the ability to translate technical quality issues into actionable feedback.
- Ability to work independently in ambiguous, fast-moving environments.
- Passion for artificial intelligence and an entrepreneurial mindset.
- Demonstrated competitive success.

## Nice-to-haves
- Experience with AI training data, RLHF, or data-annotation quality assurance.
- Experience reviewing datasets across code, reasoning, and knowledge-work domains.
- Experience designing rubrics, grading criteria, or automated quality-check tooling and scripts.
- Familiarity with Claude Code or similar AI-assisted workflow tools.
- Computer science degree or equivalent hands-on engineering experience.

## Compensation and benefits
- Salary: $150,000-$275,000 annually.
- Medical, vision, and dental insurance.
- 401(k) with employer match.
- Daily UberEats stipend.
- Monthly wellness stipend.
- Commute coverage.

## Similar jobs

- [Senior Software Engineer, Payments Quality](https://hotfix.jobs/jobs/241a13d3-fa5d-4595-b0fd-5d45056565e0) - VGS - San Francisco, CA - $170k – $215k/yr
- [Senior Validation Engineer](https://hotfix.jobs/jobs/ef31c44e-628c-4e87-8b0a-e0fdb341c624) - Applied Intuition - Sunnyvale, CA - $120k – $190k/yr
- [Senior Quality Engineer](https://hotfix.jobs/jobs/7af0e7ee-6cfd-4b65-9ef1-1bf0e4bc2c7b) - Circle - Remote - $120k – $130k/yr
- [Senior Software Development Engineer in Test](https://hotfix.jobs/jobs/5726f310-261c-4396-b337-e40056f87886) - Vestmark - Boston, MA - $110k – $140k/yr
- [Senior Quality Assurance Testing Engineer](https://hotfix.jobs/jobs/8ce238a2-210a-4f6d-991a-51ebbec975bb) - Fora - New York, NY - $110k – $140k/yr

**Apply:** https://hotfix.jobs/jobs/fa82279d-1ca3-4172-a677-c56735e1fd03
**Canonical:** https://hotfix.jobs/jobs/fa82279d-1ca3-4172-a677-c56735e1fd03