Subject Matter Expert
Part-time hourly Subject Matter Expert performing quality audits, defining evaluation standards and rubrics, analyzing performance gaps, and recommending quality improvements for specialized domain projects. Requires deep expertise in a field such as medicine, law or engineering.
About the job
Key Responsibilities
Quality Audits & Evaluation
- Conduct structured audits of task outputs to evaluate accuracy, consistency, and adherence to project guidelines.
- Apply domain expertise to assess nuanced or complex work requiring specialized knowledge.
- Identify patterns of quality issues and flag systemic gaps impacting output standards.
Quality Standards & Benchmarking
- Define and refine quality benchmarks, scoring rubrics, and evaluation criteria based on project needs.
- Contribute to the development of gold standards and reference materials for high-quality outputs.
- Ensure quality frameworks reflect domain-specific rigor where applicable.
Analysis & Insights
- Analyze audit results to generate actionable insights on quality trends and performance gaps.
- Provide structured reports with clear recommendations to improve overall output quality.
- Partner with internal stakeholders to calibrate on quality expectations and scoring consistency.
Process Improvement (Quality-Focused)
- Recommend improvements to workflows, guidelines, and evaluation processes based on audit findings.
- Support calibration efforts to ensure alignment across reviewers and quality stakeholders.
- Contribute to continuous improvement initiatives strictly related to quality outcomes.
Qualifications
- Deep domain expertise in a specialized field (e.g., medicine, law, engineering, etc.).
- Strong analytical skills with the ability to evaluate complex outputs against defined standards.
- Experience in quality assurance, auditing, or evaluation frameworks is preferred.
- Ability to produce clear, structured, and actionable feedback.
- High attention to detail and commitment to accuracy and consistency.
Engagement Expectations
- Hourly, project-based work aligned to audit volume and quality needs.
- Deliverables include completed audits, calibration input, and quality reports.
- Operates independently with minimal oversight, focusing on expertise-driven contributions.
Skills
Quality Assurance, Auditing, Quality Frameworks, Benchmarking, Analytical Skills, Domain Expertise
Similar jobs
HumanSignal
Columbus, OH
Performs unscripted household scenarios and natural conversations with a voice assistant during in-person AI training recordings. Requires improv or performance experience, comfort with camera and audio recording, and reliable attendance; compensation is $50 per hour.
Mercury
San Francisco, CAInvestigate AML, fraud, and other financial-crime alerts; respond to partner-bank information requests, assess customer activity, and escalate suspicious behavior. The role requires financial-services investigation experience, transaction-monitoring expertise, and strong communication and organizational skills.
Celonis
New York, NY
This posting is an incomplete role template for a full-time hybrid position in New York. Responsibilities and qualifications have not been provided; the posting highlights Celonis’s process intelligence platform and employee benefits.
Ascertain
United States
Processes and oversees cardiology prior authorizations, coordinates documentation with healthcare providers and payors, and helps improve AI-powered healthcare workflows. Requires 4+ years of cardiology prior authorization and billing experience plus athenahealth or NextGen proficiency.
OpenAI
San Francisco, CA
Leads child safety investigations, enforcement decisions, mandatory-reporting workflows, and process improvements involving sensitive content and abuse signals. The role requires Trust & Safety investigation experience, sound judgment, strong documentation, and cross-functional collaboration.