Safeguards Enforcement Lead, User Well-Being
Leads User Well-Being enforcement operations spanning child safety, mental health, abuse and exploitation, and age assurance. The role manages review teams and partners cross-functionally to scale workflows, improve detection systems, monitor risks, and meet reporting obligations.
About the job
Responsibilities
- Manage a team of individual contributors across child safety, mental health, abuse and exploitation, and age assurance policy areas.
- Serve as the primary contact for content-review partners, including onboarding, training, quality assurance, and relationship management.
- Design and improve scalable enforcement workflows while maintaining accuracy and consistency.
- Partner with Engineering and Data Science to optimize detection models and automated enforcement systems.
- Develop documentation, decision trees, and review guidelines for consistent enforcement.
- Monitor emerging AI policy-enforcement practices, legal frameworks, and technology developments.
- Identify misuse trends and communicate findings to Product, Policy, Engineering, Legal, and Trust & Safety stakeholders.
- Coordinate legally required reporting to external bodies such as NCMEC.
Requirements
- Experience managing teams in User Well-Being, trust and safety, content moderation operations, or policy enforcement.
- Direct experience with child safety, mental health, abuse and exploitation, and age assurance harms.
- Experience managing or coordinating content-review operations, quality assurance, and workflow management.
- Experience establishing and scaling policy-enforcement or content-review workflows.
- Proficiency in SQL or other data-analysis tools for monitoring workflow health, queue metrics, and enforcement trends.
- Experience identifying emerging risks and communicating findings cross-functionally.
- Understanding of implementing product policies at scale in content moderation.
- Bachelor’s degree or equivalent combination of education, training, and experience.
Nice-to-haves
- Expertise in child safety, CSEA, online child protection, mental wellness, and age assurance.
- Experience with NCMEC, IWF, or equivalent reporting bodies.
- Familiarity with CSAM reporting obligations, KOSA, COPPA, or comparable international frameworks.
- Experience with generative AI products and misuse risks.
- Experience designing or evaluating trauma-informed reviewer support and wellness protocols.
- Python proficiency for workflow automation or data analysis.
- Experience with PhotoDNA, CSAI Match, perceptual hashing, or other hash-matching technologies.
- Familiarity with age-assurance technologies.
Compensation
- Annual salary: $285,000–$330,000 USD.
Skills
SQL, Python, Data Analysis, Content Moderation, Quality Assurance, Workflow Management, Policy Enforcement, Trust & Safety, Generative AI, Photodna, Csai Match, Perceptual Hashing, Age Assurance, Coppa, Kosa
Similar jobs
Customer Success jobs
OpenAI
San Francisco, CA
Leads OpenAI’s Americas executive-engagement portfolio, team, operating model, and customer-facing programs. The role requires 10+ years of experience, strong commercial judgment, and the ability to scale high-touch executive experiences while preserving strategic customization.
Anthropic
San Francisco, CAOwns a portfolio of partner-delivered customer engagements from matching through successful completion, focusing on delivery quality, Claude adoption, risk resolution, and partner practice development. The role requires experience managing concurrent engagements, usage-based customer outcomes, systems integrators, executive stakeholders, and repeatable operating playbooks.
Anthropic
San Francisco, CALeads and grows a Customer Success team supporting Global Systems Integrators and consulting partners adopting Anthropic’s AI products. The role requires enterprise customer leadership, GSI experience, front-line management, and the ability to build scalable adoption, retention, and expansion programs.
Anthropic
New York, NYDrives strategic enterprise customer relationships, AI adoption, product usage optimization, and expansion across Anthropic’s Claude offerings. Requires 8+ years in customer success, technical account management, or solutions engineering, plus strong AI/ML and API fluency.
Anthropic
San Francisco, CALeads and develops a customer success team while managing strategic nonprofit accounts and driving adoption, value realization, retention, and expansion. The role requires 7+ years of customer-facing experience, frontline management experience, nonprofit expertise, and technical fluency with AI/ML products.