Safeguards Enforcement Analyst, Child Safety

Key Responsibilities

• Own day-to-day operational management of child safety content review workflows, including task routing, queue management, escalation handling, and SLA monitoring.
• Serve as primary point of contact for review partners conducting child safety content review, including onboarding, training, quality assurance, and ongoing relationship management.
• Design and improve enforcement workflows to scale effectively as volume grows, while maintaining high accuracy and consistency across review decisions.
• Partner with Engineering and Data Science teams to optimize detection models and automated enforcement systems for CSAM, CSEM, and related child safety policy violations.
• Review novel or ambiguous flagged content to drive enforcement decisions and surface policy gaps to the Safeguards policy design team.
• Develop and maintain internal documentation, decision trees, and review guidelines that enable accurate and consistent enforcement at scale.
• Keep up to date with emerging AI policy enforcement best practices, evolving legal frameworks, and developments in child safety technology, and use these to inform our workflows.
• Identify and report trends in misuse patterns to internal stakeholders, including Policy, Legal, and Trust & Safety leadership.
• Coordinate reporting obligations to relevant external bodies (e.g., NCMEC) in accordance with applicable law and Anthropic policy.

Minimum Qualifications

• Experience in trust & safety, content moderation operations, or policy enforcement with direct exposure to child safety, CSAM/CSEM, or related child protection harm areas.
• Experience managing or coordinating content review operations, including quality assurance and workflow management.
• Experience standing up and scaling policy enforcement or content review workflows.
• Proficiency in SQL and/or other data analysis tools to monitor workflow health, review queue metrics, and surface enforcement trends.
• Experience identifying emerging risks and communicating findings to cross-functional stakeholders, such as Product, Policy, Engineering, and Legal teams.
• Understanding of the challenges involved in implementing product policies at scale in the content moderation space.

Preferred Qualifications

• Deep subject matter expertise in child safety, child sexual exploitation and abuse (CSEA), or online child protection, including familiarity with CSAM/CSEM classification standards (e.g., COPINE, SAM scale).
• Experience working with or reporting to NCMEC, IWF, or equivalent child safety reporting bodies.
• Familiarity with relevant legal and regulatory frameworks, including CSAM reporting obligations, KOSA, COPPA, or equivalent international frameworks.
• Experience working with generative AI products, including an understanding of how AI systems can be misused to generate or facilitate CSEA.
• Experience designing or evaluating trauma-informed support structures and wellness protocols for content reviewers working with harmful material.
• Proficiency in Python for workflow automation or data analysis.
• Experience working with hash-matching technologies (e.g., PhotoDNA, CSAI Match) or perceptual hashing tools used in CSAM detection.
• Familiarity with age assurance technologies and their role in child safety enforcement.
• Experience in a trust & safety role at a technology company, with an understanding of how platform policy intersects with child protection obligations.

Compensation

Annual Salary: $245,000–$285,000 USD

Education

• Bachelor’s degree or an equivalent combination of education, training, and/or experience in a field relevant to the role.