Safeguards Enforcement Lead, Cyber Harms

Leads cyber-focused AI misuse enforcement, managing analysts and contractors while developing detection and mitigation strategies for attacks, malware, and exploitation. Requires people management, cybersecurity expertise, high-volume abuse enforcement, data analysis with SQL or Python, and cross-functional risk communication.

About the job

Responsibilities

Manage Cyber Enforcement Analysts and contractors, overseeing the vision and execution of cyber enforcement strategy.
Develop strategies to detect and mitigate misuse of AI systems for cyberattacks, malware creation, exploitation tooling, and related harmful cyber operations.
Collaborate with stakeholders on novel, ambiguous, and high-severity cases.
Partner with the Safeguards Policy Design Team to address policy gaps identified through enforcement scenarios.
Work with Engineering and Data Science teams to support enforcement tooling and measurement.
Monitor emerging AI policy-enforcement practices, threat actor tactics, and the evolving cyber threat landscape.
Respond to escalations during weekends and holidays as needed.

Requirements

Experience managing people.
Cybersecurity experience, including offensive techniques, exploit development, malware analysis, or vulnerability research.
Experience with content review, abuse investigations, or high-volume policy enforcement.
Proficiency in SQL and/or Python for data analysis and threat detection.
Experience identifying emerging risks and communicating findings to Product, Policy, Engineering, and Legal stakeholders.
Experience working with generative AI products, including writing effective prompts for content review and enforcement.
Bachelor's degree or equivalent combination of education, training, and experience in a relevant field.

Nice-to-haves

Experience in trust and safety, abuse investigations, cybersecurity investigations, or threat intelligence at a technology or AI company.
Experience with large language models and AI misuse in cyber operations.
Experience operating abuse-monitoring programs or enforcement-review systems.
Understanding of implementing product policies at scale, including content moderation.
Experience working with government agencies, regulated environments, or information-sharing communities.

Compensation

Annual salary: $285,000–$330,000 USD.

Skills

Cybersecurity, Exploit Development, Malware Analysis, Vulnerability Research, SQL, Python, Generative AI, Prompt Engineering, LLMs, Threat Intelligence, Content Moderation, Data Analysis