# Senior AI Product Manager, Leaderboard

**Company:** [Scale AI](https://hotfix.jobs/companies/scale-ai)
**Location:** New York, NY, San Francisco, CA
**Role:** Product Management
**Salary:** $206k – $257k/yr
**Experience:** 5+ years
**Skills:** Product Management, Machine Learning, ai model evaluation, benchmarking, data products, Product Roadmap, Product Strategy, Stakeholder Management, Executive Communication, Analytics, Evaluation Frameworks, infrastructure automation, governance, release management, auditability
**Posted:** 2026-08-04

> Owns the strategy, roadmap, governance, and growth of AI evaluation benchmarks and leaderboards. The role partners with researchers, engineering, operations, GTM teams, AI labs, and enterprise customers, requiring at least five years of relevant product or technical experience and strong AI evaluation fluency.

## Job Description

## Responsibilities

- Own the roadmap and strategy for Scale’s SEAL Leaderboard portfolio, defining priorities across benchmark development, leaderboard launches, infrastructure investments, and product expansion.
- Facilitate the Leaderboard Steering Committee and drive alignment across AI Product Management, ML, Engineering, Operations, and Go-To-Market stakeholders.
- Evaluate, prioritize, and operationalize new leaderboard proposals based on customer demand, market opportunities, and company strategy.
- Manage the end-to-end leaderboard product lifecycle, from ideation and benchmark design through launch, growth, maintenance, and sunset decisions.
- Partner with ML researchers and domain experts to develop evaluation methodologies, benchmark specifications, and leaderboard scoring frameworks.
- Drive roadmap development for leaderboard infrastructure, automation, and operational tooling.
- Establish governance processes for benchmark quality, evaluation integrity, release management, auditability, and update cadence.
- Work with frontier AI labs and enterprise customers to understand evaluation needs and guide future investments.
- Track adoption, usage, customer impact, and business outcomes to guide roadmap decisions and resource allocation.
- Identify evaluation categories, benchmark opportunities, and leaderboard products that create business impact and revenue opportunities.
- Collaborate with Go-To-Market teams on customer engagements, thought leadership, product launches, and strategic partnerships.

## Requirements

- 5+ years of experience in product management, technical program management, consulting, or customer-facing technical roles.
- Strong technical fluency with machine learning systems, AI model evaluation, benchmarking, or data products.
- Experience building and scaling products requiring coordination across engineering, operations, and business teams.
- Excellent stakeholder management and executive communication skills.
- Strong analytical skills and the ability to translate ambiguous market and customer signals into product strategy.
- Entrepreneurial mindset and a track record of creating products, programs, or business initiatives from the ground up.
- Bias for action and comfort operating in fast-moving, ambiguous environments.
- Passion for trustworthy AI evaluation and industry standards for measuring frontier model capabilities.

## Nice to Have

- Experience working with AI researchers, ML teams, or evaluation frameworks.

## Compensation and Benefits

- Base salary range: **$205,600–$257,000 USD**.
- Compensation may include base salary, equity, and benefits; the final offer depends on work location, skills, experience, qualifications, interview performance, and education or training.
- Benefits include health, dental, and vision coverage, retirement benefits, a learning and development stipend, generous paid time off, and potentially a commuter stipend.

## Similar roles

- [Senior AI Product Manager, Cybersecurity](https://hotfix.jobs/jobs/23d351e3-3679-4796-854b-e0775480bd8f) - Scale AI - New York, NY - $206k – $257k/yr
- [Senior AI Product Manager, Code](https://hotfix.jobs/jobs/90edba00-393e-422c-a190-0cebc98bf443) - Scale AI - New York, NY - $206k – $257k/yr
- [Senior AI Product Manager, Healthcare Agents](https://hotfix.jobs/jobs/91806344-bff7-453a-b102-c118ca246b99) - Scale AI - San Francisco, CA - $206k – $257k/yr
- [Product Manager, Enterprise Core Platform](https://hotfix.jobs/jobs/4a2acdc8-d582-45de-a8a9-059d650d7cde) - Scale AI - New York, NY - $206k – $300k/yr
- [Senior Technical Product Manager - Data and Pricing Services](https://hotfix.jobs/jobs/7ea0cd87-2872-47fc-9696-c876b3b0e7e5) - Zoox - Foster City, CA - $205k – $246k/yr

**Apply:** https://hotfix.jobs/jobs/a5926077-7f17-4637-90b4-8bf7c8b7b122
**Canonical:** https://hotfix.jobs/jobs/a5926077-7f17-4637-90b4-8bf7c8b7b122