Skip to content

Senior Machine Learning Engineer - Policy & Safety

Designs, builds, and deploys production ML systems for content safety, moderation, and policy enforcement at Spotify scale. Leads technical initiatives, develops multimodal/LLM models, and collaborates with Trust & Safety, Legal teams on safety-critical systems.

New York, NYML EngineeringHybrid

About the role

What You'll Do

  • Design, build, and ship production-grade machine learning systems that power content safety and policy enforcement at Spotify scale
  • Own and lead key technical initiatives across detection, classification, and policy evaluation systems
  • Develop and maintain ML models for content moderation, including multimodal and LLM-based systems
  • Build robust evaluation frameworks, including standardized datasets, offline and online metrics, and continuous improvement loops
  • Drive experimentation to improve model performance, reliability, and fairness in safety-critical systems
  • Collaborate closely with cross-functional partners in Trust & Safety, Legal, and Public Affairs to align on policy and enforcement needs
  • Provide technical leadership within the team, mentoring engineers and contributing to ML strategy and prioritization
  • Represent technical decisions and trade-offs in stakeholder discussions and influence product direction

Who You Are

  • Solid experience building and deploying machine learning systems in production environments at scale
  • Experienced with training, evaluating, and maintaining ML models using modern frameworks such as PyTorch
  • Deep understanding of machine learning evaluation, including dataset design, metrics, and continuous improvement systems
  • Know how to design systems that balance performance, reliability, and real-world impact in high-stakes domains
  • Care about building safe, responsible, and user-centric ML systems
  • Comfortable working across disciplines, partnering with legal, policy, and product stakeholders
  • Experience leading technical projects and influencing direction within a team or product area
  • Experience with distributed systems or backend technologies (e.g., Scala)

Skills

PyTorchMachine LearningLLMsMultimodal ModelsScalaDistributed SystemsMl EvaluationContent ModerationPolicy EnforcementEvaluation Frameworks

Similar roles

ML Engineering jobs

Senior Software Engineer

Build and own production AI agent systems (harnesses, evals, orchestration) on frontier LLMs for industrial supply chain workflows. Requires 5+ years software engineering with 1+ year shipping LLM/agent features, strong Python/TS, and high-agency customer immersion.

200k – 240kNew York, NY +1ML EngineeringOn-site5+ YOEWmsTms

Senior Machine Learning Engineer

Lead projects building and deploying large-scale ASR, NLP, and LLM systems for meeting intelligence. Requires 5+ years building production ML systems with PyTorch/JAX and experience with speech/language models.

230k – 265kMountain View, CAML EngineeringHybrid5+ YOEJAXAsr

Sr AI Engineer - Agentic Systems

Technical leader building and scaling production-grade multi-agent AI systems for real-time voice, workflow automation, and enterprise tool execution. Requires 8+ years experience and deep expertise in LLM platforms, agent frameworks, and distributed systems.

United StatesML EngineeringRemote8+ YOECrewaiVoice Ai

Agent Post-Training, Artifacts Research

Train frontier models to generate polished artifacts (docs, spreadsheets, slides) by owning post-training improvements across RL, data, evals, and alignment. Requires strong ML fundamentals and hands-on LLM/RL experience.

295k – 445kSan Francisco, CAML EngineeringOn-site7+ YOELLMsRLHF

Agent Post-Training, Computer Use Research

Train frontier models to operate computers, browsers, and desktops. Design experiments, build evals, own post-training pipelines (RL, data, graders), and ship improvements into OpenAI agents.

295k – 445kSan Francisco, CAML EngineeringOn-site7+ YOERLHFLLMs