# Senior Machine Learning Engineer, Personalization, Magenta

**Company:** [Spotify](https://hotfix.jobs/companies/spotify)
**Location:** Remote
**Role:** ML Engineering
**Experience:** 5+ years
**Skills:** Machine Learning, LLMs, Conversational AI, Agentic AI, Llm-As-Judge, Context Management, Multi-Step Reasoning, Evaluation Frameworks, Production Ml Systems
**Posted:** 2026-05-07

> Designs and ships production ML systems for conversational AI personalization at Spotify, focusing on user intent interpretation, agentic workflows, context management, and scalable evaluation frameworks. Requires 5+ years experience with LLMs and production ML.

## Job Description

## What You'll Do
- Design and ship production-grade machine learning systems powering conversational and agentic AI experiences
- Build systems that interpret user intent, manage context across multi-turn interactions, and handle ambiguity reliably at scale
- Develop and evolve agentic workflows including memory, context management, and multi-step tool orchestration
- Create evaluation frameworks, including LLM-as-judge pipelines, to measure quality and guide iteration
- Partner closely with product, engineering, and design to deliver seamless, user-facing experiences
- Balance experimentation with production rigor, ensuring performance, latency, and reliability at Spotify scale
- Continuously improve agent behavior through tight feedback loops between evaluation and real-world usage

## Who You Are
- 5+ years of experience building and shipping machine learning systems in production environments
- Experienced with large language models and have worked on real-world applications beyond experimentation; shipped and maintained large scale systems with LLMs
- Deep understanding of challenges in conversational or agentic systems, such as context handling and multi-step reasoning
- Know how to evaluate ML systems rigorously and have experience designing metrics or evaluation pipelines
- Comfortable debugging complex interactions between models, tools, and system constraints like latency
- Care about building reliable, scalable systems that deliver high-quality user experiences
- Enjoy working cross-functionally and contributing to a collaborative, inclusive team environment

## Similar roles

- [Senior Machine Learning Engineer, Agent Oversight](https://hotfix.jobs/jobs/1f504a69-044f-47ab-872b-120a1706cd88) - Scale AI - San Francisco, CA - $216k – $270k/yr
- [Senior Software Engineer, Agent Oversight](https://hotfix.jobs/jobs/808ce719-6b16-4b6e-8887-8c8f8a780b75) - Scale AI - San Francisco, CA - $216k – $270k/yr
- [Senior Software Engineer, AI Infrastructure](https://hotfix.jobs/jobs/dd1c3420-6c0a-47ed-a1a7-de401bdf506c) - Ambient.ai - Redwood City, CA - $168k – $205k/yr
- [Senior Software Engineer](https://hotfix.jobs/jobs/423c60aa-ca4c-400d-babe-a50099433cbb) - SpotOn - Chicago, IL - $160k – $190k/yr
- [Senior AI Engineer, Enterprise](https://hotfix.jobs/jobs/87a30fd1-3fe6-47f3-a0a1-da444f3c00f4) - Snowflake - Menlo Park, CA - $156k – $224k/yr

**Apply:** https://hotfix.jobs/jobs/6b17b661-04f3-4849-b145-22099d4e6317
**Canonical:** https://hotfix.jobs/jobs/6b17b661-04f3-4849-b145-22099d4e6317