# Subject Matter Expert

**Company:** [Scale AI](https://hotfix.jobs/companies/scale-ai)
**Location:** Remote
**Role:** Other
**Skills:** Quality Assurance, Auditing, Quality Frameworks, Benchmarking, Analytical Skills, Domain Expertise
**Posted:** 2026-07-01

> Part-time hourly Subject Matter Expert performing quality audits, defining evaluation standards and rubrics, analyzing performance gaps, and recommending quality improvements for specialized domain projects. Requires deep expertise in a field such as medicine, law or engineering.

## Job Description

## Key Responsibilities

**Quality Audits & Evaluation**
- Conduct structured audits of task outputs to evaluate accuracy, consistency, and adherence to project guidelines.
- Apply domain expertise to assess nuanced or complex work requiring specialized knowledge.
- Identify patterns of quality issues and flag systemic gaps impacting output standards.

**Quality Standards & Benchmarking**
- Define and refine quality benchmarks, scoring rubrics, and evaluation criteria based on project needs.
- Contribute to the development of gold standards and reference materials for high-quality outputs.
- Ensure quality frameworks reflect domain-specific rigor where applicable.

**Analysis & Insights**
- Analyze audit results to generate actionable insights on quality trends and performance gaps.
- Provide structured reports with clear recommendations to improve overall output quality.
- Partner with internal stakeholders to calibrate on quality expectations and scoring consistency.

**Process Improvement (Quality-Focused)**
- Recommend improvements to workflows, guidelines, and evaluation processes based on audit findings.
- Support calibration efforts to ensure alignment across reviewers and quality stakeholders.
- Contribute to continuous improvement initiatives strictly related to quality outcomes.

## Qualifications
- Deep domain expertise in a specialized field (e.g., medicine, law, engineering, etc.).
- Strong analytical skills with the ability to evaluate complex outputs against defined standards.
- Experience in quality assurance, auditing, or evaluation frameworks is preferred.
- Ability to produce clear, structured, and actionable feedback.
- High attention to detail and commitment to accuracy and consistency.

## Engagement Expectations
- Hourly, project-based work aligned to audit volume and quality needs.
- Deliverables include completed audits, calibration input, and quality reports.
- Operates independently with minimal oversight, focusing on expertise-driven contributions.

## Similar roles

- [Safeguards Enforcement Analyst, Violence & Extremism](https://hotfix.jobs/jobs/34f1c3de-6d13-4ace-9c2c-ef1154afd6ef) - Anthropic - San Francisco, CA - $285k – $330k/yr
- [Indirect Tax Filings Specialist](https://hotfix.jobs/jobs/23fde4b4-65cf-493b-a274-86e8a616e6e9) - Sphere - Remote
- [SEO Manager](https://hotfix.jobs/jobs/019e1a21-04b1-463f-8959-354fec4a5013) - Givebutter - Remote - $95k – $110k/yr
- [Manager, Credit Risk Strategy](https://hotfix.jobs/jobs/16440ffd-aaa7-4906-9d50-7c1fb3ec68bb) - Octane - New York, NY - $110k – $150k/yr
- [Payroll Analyst, Global Payroll](https://hotfix.jobs/jobs/240fd6ae-6c1e-4a09-bbbe-b29abcbb8bb4) - Chainguard - Remote - $106k – $125k/yr

**Apply:** https://hotfix.jobs/jobs/4e91a740-ec68-44c5-92a8-502016b95493
**Canonical:** https://hotfix.jobs/jobs/4e91a740-ec68-44c5-92a8-502016b95493