Senior Machine Learning Engineer - Policy & Safety
Designs, builds, and deploys production ML systems for content safety, moderation, and policy enforcement at Spotify scale. Leads technical initiatives, develops multimodal/LLM models, and collaborates with Trust & Safety, Legal teams on safety-critical systems.
About the job
What You'll Do
- Design, build, and ship production-grade machine learning systems that power content safety and policy enforcement at Spotify scale
- Own and lead key technical initiatives across detection, classification, and policy evaluation systems
- Develop and maintain ML models for content moderation, including multimodal and LLM-based systems
- Build robust evaluation frameworks, including standardized datasets, offline and online metrics, and continuous improvement loops
- Drive experimentation to improve model performance, reliability, and fairness in safety-critical systems
- Collaborate closely with cross-functional partners in Trust & Safety, Legal, and Public Affairs to align on policy and enforcement needs
- Provide technical leadership within the team, mentoring engineers and contributing to ML strategy and prioritization
- Represent technical decisions and trade-offs in stakeholder discussions and influence product direction
Who You Are
- Solid experience building and deploying machine learning systems in production environments at scale
- Experienced with training, evaluating, and maintaining ML models using modern frameworks such as PyTorch
- Deep understanding of machine learning evaluation, including dataset design, metrics, and continuous improvement systems
- Know how to design systems that balance performance, reliability, and real-world impact in high-stakes domains
- Care about building safe, responsible, and user-centric ML systems
- Comfortable working across disciplines, partnering with legal, policy, and product stakeholders
- Experience leading technical projects and influencing direction within a team or product area
- Experience with distributed systems or backend technologies (e.g., Scala)
Skills
PyTorch, Machine Learning, LLMs, Multimodal Models, Scala, Distributed Systems, Ml Evaluation, Content Moderation, Policy Enforcement, Evaluation Frameworks
Similar jobs
ML Engineering jobs
Mercury
San Francisco, CABuild and operate the platform that deploys, serves, observes, and retrains production machine-learning models for real-time fraud and financial-crime risk decisions. Requires 5+ years of ML engineering, backend, or MLOps experience, strong Python skills, and production model-serving expertise.
Traba
New York, NYBuild and deploy production AI-agent systems, including their harnesses, evaluations, orchestration, and supporting services. The role requires 5+ years of software engineering experience, production LLM or agent experience, and strong Python or TypeScript/Node.js skills.
Front
San Francisco, CA
Build and deploy generative AI and LLM-powered agentic applications at Front to automate customer support inquiries, enhance product capabilities, and drive operational insights. Requires 5+ years software engineering experience with strong production AI/ML focus, agentic/RAG expertise, and proficiency in Node.js, TS, and Python.
Baselayer
San Francisco, CA
Senior AI Engineer responsible for production LLM agents that enrich business identity data through web discovery, verification, classification, and risk scoring. The role requires strong asynchronous Python, agent and evaluation expertise, browser automation, and experience operating AI systems in production.
Blee
San Francisco, CA
Designs and ships production multi-agent compliance systems, including LLM pipelines, model training, evaluation, monitoring, and explainability. Requires 5+ years of applied AI/ML engineering experience, strong Python, and experience deploying production ML systems.