Skip to content
Thinking Machines LabThinking Machines LabSan Francisco, CA

Safety Operations Lead

Leads operational trust and safety for human-AI collaboration products by reviewing abuse cases, enforcing policy, and building automation and detection systems. Requires 7+ years of recurring case-queue experience plus expertise in AI abuse risks, policy operations, and production safety incidents.

190k – 300k/yr
Hybrid7+ YOESecurity Engineering

About the role

Responsibilities

  • Review flagged content, safety escalations, and account-level abuse signals daily.
  • Triage cases, apply policy judgment, and take action through content flags, account reviews, bans, and recovery workflows.
  • Design and refine safety policy across the product stack with engineering, legal, safety research, and security stakeholders.
  • Build and maintain tooling and automation, including triage agents, ban/recovery workflows, abuse detection frameworks, and templates.
  • Partner with product teams to embed safety into product experiences, including model refusals, content flagging, account review, and safety protections.
  • Improve observability and detection for safety-relevant events, model safety trends, abuse patterns, and malicious behavior in production.

Requirements

  • 7+ years in an operational trust and safety, content moderation, or fraud/abuse operations role with direct, recurring responsibility for a case queue.
  • Experience owning policy definition, operationalization, and enforcement end to end.
  • Direct case experience with cybersecurity abuse, CBRN-relevant risk, youth safety, or prompt injection in a production environment.
  • Working familiarity with model safety and abuse risk categories, including jailbreaks, prompt injection, and scaled abuse.
  • Practical experience using AI tools such as Claude, Codex, or similar to build or accelerate operational workflows.

Nice-to-haves

  • Experience with safety and integrity operations on AI-powered products or LLM APIs.
  • Track record of turning recurring case patterns into reusable tooling, workflows, or process improvements while continuing to own the underlying queue.
  • Experience training, onboarding, or setting quality standards for moderators or reviewers.

Compensation and Benefits

  • Expected annual salary range: $190,000-$300,000.
  • Health, dental, and vision benefits.
  • Unlimited PTO.
  • Paid parental leave.
  • Relocation support as needed.
  • Visa sponsorship.

Skills

trust and safetycontent moderationfraud preventionabuse detectionsafety policyprompt injectionjailbreak detectionCybersecurityAI ToolsLLM APIs
Apollo

Senior Application Security Engineer

ApolloUnited States

Senior individual contributor responsible for strengthening Apollo's secure software development lifecycle, performing application security reviews, threat modeling, vulnerability management, and AI security for product, platform, and AI-powered features.

190k – 273k/yrRemote5+ YOESecurity Engineering
Skydio

Senior Software Engineer - Security

SkydioSan Mateo, CA

Designs, reviews, and builds security systems for multi-tenant cloud and corporate environments, including architecture guidance, internal tooling like WAF and vuln management, and compliance controls. Requires 5+ years in cloud security, AWS expertise, and strong Python/Go coding skills.

190k – 250k/yrHybrid5+ YOESecurity Engineering
Sentry

Senior Security Engineer, Application & Platform Security

SentrySan Francisco, CA

Senior Security Engineer drives security solutions for Sentry's cloud-based application and Kubernetes platform, partnering with engineering on architecture, threat modeling, and implementations. Requires 6+ years experience securing distributed systems, cloud/container environments, and programming in Python/Go/Rust.

190k – 280k/yrHybrid6+ YOESecurity Engineering
Replit

Senior Software Engineer, Anti-Abuse & Security

ReplitFoster City, CA

Builds AI-powered anti-abuse detection systems using LLMs to combat phishing, cryptomining, and platform exploitation at scale. Requires 4+ years in security engineering with Python/TypeScript and data analysis experience.

190k – 240k/yrHybrid4+ YOESecurity Engineering
Upstart

Senior Security Engineering Manager, Product Security

UpstartUnited States

Lead a team of security engineers scaling secure-by-design practices across application, infrastructure, offensive, and product security. Partner with engineering and risk leaders to reduce systemic risk and improve security posture of customer-facing products and cloud-native services.

191k – 264k/yrRemote8+ YOESecurity Engineering