Senior AI Product Manager, Leaderboard

Responsibilities

• Own the roadmap and strategy for Scale’s SEAL Leaderboard portfolio, defining priorities across benchmark development, leaderboard launches, infrastructure investments, and product expansion.
• Facilitate the Leaderboard Steering Committee and drive alignment across AI Product Management, ML, Engineering, Operations, and Go-To-Market stakeholders.
• Evaluate, prioritize, and operationalize new leaderboard proposals based on customer demand, market opportunities, and company strategy.
• Manage the end-to-end leaderboard product lifecycle, from ideation and benchmark design through launch, growth, maintenance, and sunset decisions.
• Partner with ML researchers and domain experts to develop evaluation methodologies, benchmark specifications, and leaderboard scoring frameworks.
• Drive roadmap development for leaderboard infrastructure, automation, and operational tooling.
• Establish governance processes for benchmark quality, evaluation integrity, release management, auditability, and update cadence.
• Work with frontier AI labs and enterprise customers to understand evaluation needs and guide future investments.
• Track adoption, usage, customer impact, and business outcomes to guide roadmap decisions and resource allocation.
• Identify evaluation categories, benchmark opportunities, and leaderboard products that create business impact and revenue opportunities.
• Collaborate with Go-To-Market teams on customer engagements, thought leadership, product launches, and strategic partnerships.

Requirements

• 5+ years of experience in product management, technical program management, consulting, or customer-facing technical roles.
• Strong technical fluency with machine learning systems, AI model evaluation, benchmarking, or data products.
• Experience building and scaling products requiring coordination across engineering, operations, and business teams.
• Excellent stakeholder management and executive communication skills.
• Strong analytical skills and the ability to translate ambiguous market and customer signals into product strategy.
• Entrepreneurial mindset and a track record of creating products, programs, or business initiatives from the ground up.
• Bias for action and comfort operating in fast-moving, ambiguous environments.
• Passion for trustworthy AI evaluation and industry standards for measuring frontier model capabilities.

Nice to Have

• Experience working with AI researchers, ML teams, or evaluation frameworks.

Compensation and Benefits

• Base salary range: $205,600–$257,000 USD.
• Compensation may include base salary, equity, and benefits; the final offer depends on work location, skills, experience, qualifications, interview performance, and education or training.
• Benefits include health, dental, and vision coverage, retirement benefits, a learning and development stipend, generous paid time off, and potentially a commuter stipend.