Staff Platform Manager, Conversational Products
Own the platform and evaluation strategy for Airbnb’s AI Assistant, shaping how it reasons, retrieves knowledge, takes actions, and resolves support issues safely at scale. Requires 9+ years building technology products, production generative AI or ML experience, strong technical and data fluency, and deep LLM evaluation expertise.
About the job
Responsibilities
- Set the product direction and multi-quarter vision for the AI Assistant platform.
- Own how the assistant interprets requests, routes them, retrieves knowledge, invokes capabilities, takes actions, and responds.
- Define complete, correct resolutions and align engineering, policy, and knowledge partners around them.
- Establish measurable success criteria for resolution rate, accuracy, safety, and launch readiness.
- Build capabilities end to end, including hands-on product artifacts, calibration, and human input.
- Diagnose complex AI-system failures and determine where fixes belong.
- Own evaluation strategy, including LLM-based evaluators, offline and live-traffic evaluation, calibration, certification, and tooling.
- Align cross-functional teams, establish agreements, and maintain a single source of truth.
- Present decisions, tradeoffs, and asks to senior leadership.
Requirements
- 9+ years building technology products, including at least 5 years in product management or a closely related technical role such as engineering, data science, or applied research.
- Experience shipping generative AI or ML products to production.
- Hands-on technical depth with prompts, ML constraints, and engineering systems.
- Ability to work directly with production data and validate analyses end to end.
- Experience designing, calibrating, or certifying automated model-based evaluations.
- Strong understanding of AI user experience, including latency, tone, and trust.
- Ability to lead ambiguous, cross-cutting initiatives and drive alignment across teams.
- Track record of scaling impact through others.
- Strong executive communication and execution skills.
Nice-to-haves
- Experience with retrieval-augmented generation.
- Experience with agentic architectures.
- Experience with function-calling architectures.
- Experience building evaluation systems.
- Experience using AI tools and coding agents.
Compensation and Benefits
- Base pay range: $200,000–$240,000 USD.
- May also be eligible for bonus, equity, benefits, and Employee Travel Credits.
Skills
Generative AI, Machine Learning, LLMs, Retrieval-Augmented Generation, Agentic AI, Function Calling, Llm Evaluation, Prompt Engineering, Production Data, Data Analysis, Python, Ai Assistants, Model Calibration, Model Certification, Offline Evaluation
Similar jobs
Product Management jobs
Zocdoc
New York, NY
Leads zero-to-one specialty-care marketplace products, partnering with healthcare providers and internal teams to create patient journeys from discovery through ongoing treatment. Requires 6+ years of product management experience and expertise in consumer healthcare, marketplaces, partnerships, and experimentation.
Airbnb
United States
Own the strategy, tooling, and workflow infrastructure supporting high-volume operations, including case and workforce management and AI-assisted processes. The role requires 10+ years of product or operations technology experience, strong technical fluency, and a record of delivering complex systems across teams.
Crusoe
San Francisco, CAOwn the product strategy and roadmap for Crusoe’s block, file, and object storage products, translating customer needs into scalable cloud infrastructure capabilities. Requires 5+ years of technical product management or product-minded engineering experience, storage expertise, and strong cross-functional leadership.
Grow Therapy
San Francisco, CAStaff Product Manager owning growth of new client acquisition and first bookings across awareness, consideration, conversion, referrals, and marketing technology. The role leads 0-to-1 bets, funnel experimentation, executive alignment, and cross-functional collaboration across Marketing, Client, Provider, and Payer teams.
Zocdoc
New York, NY
Leads strategy and zero-to-one development of healthcare payments products for medical practices, spanning patient responsibility, collections, reconciliation, claims, and remittance workflows. Requires 6+ years of B2B product management experience and deep healthcare insurance expertise, including 835 and 837 files.