# Product Manager, APEX

**Company:** [Mercor](https://hotfix.jobs/companies/mercor)
**Location:** San Francisco, CA
**Role:** Product Management
**Salary:** $180k – $300k/yr
**Experience:** 5+ years
**Skills:** Product Management, Technical Program Management, Machine Learning, Data Science, Rubric Design, Inter-Rater Reliability, Agentic Harnesses, Contamination Testing, Overfitting, Evaluation Pipelines, Leaderboard Design, Python
**Posted:** 2026-08-19

> Own the strategy, integrity, infrastructure, and adoption of Mercor’s APEX AI evaluation products and public leaderboards. The role requires 5+ years in product management or a customer-facing technical role, strong evaluation literacy, technical fluency, and the ability to align research, engineering, operations, and go-to-market teams.

## Job Description

## Responsibilities
- Own the roadmap and portfolio strategy for APEX benchmarks, evaluation products, infrastructure, and public and private leaderboards.
- Evaluate and prioritize new benchmark proposals against customer demand and company strategy.
- Enforce evaluation integrity through contamination policies, holdout strategies, versioning, auditability, and release cadence.
- Own the end-to-end evaluation pipeline, including harness execution, grading, model onboarding, hyperparameter scaffolds, cost and latency reporting, and leaderboard publication.
- Work with frontier AI labs and enterprise customers to understand evaluation needs, present results, and inform future benchmarks.
- Support go-to-market launches, partnerships, and thought leadership.
- Connect leaderboard demand signals to loss-analysis investments and dataset production; track adoption, usage, and revenue impact.
- Write product specifications and PRDs, inspect trajectories, spot-check failures, and make small code changes to improve the system.

## Requirements
- 5+ years of experience in product management, technical program management, or a customer-facing technical role.
- Prior experience in software engineering, machine learning, or data science is strongly preferred.
- Fluency in rubric design, inter-rater reliability, agentic harnesses, contamination, overfitting, and evaluation uncertainty.
- Ability to distinguish genuine capability gaps from measurement noise.
- Strong public judgment and the ability to publish neutral, precise, and defensible model evaluations.
- Strong instincts for identifying valuable capabilities and meaningful results.
- Track record of building a product, program, or business line from the ground up.
- High ownership and accountability for outcomes.
- Ability to work independently in ambiguous contexts.
- Ability to align research, engineering, operations, and go-to-market stakeholders around a shared methodology.

## Benefits
- Bi-annual performance bonus structure
- Generous equity grant vested over 4 years
- Up to $15,000 relocation bonus
- $10,000 housing bonus for employees living within 0.5 miles of the office
- $1,500 monthly meal stipend
- Free Equinox membership
- $200 monthly laundry reimbursement
- $200 monthly personal wellness reimbursement
- Health, dental, and vision insurance

## Similar jobs

- [Product Manager](https://hotfix.jobs/jobs/2d7b0167-2972-4b8c-9500-66e489876e4b) - SpotOn - Chicago, IL - $180k – $225k/yr
- [Product Manager](https://hotfix.jobs/jobs/9a71078b-b34d-41a5-93f7-04c79b95e728) - Tessera Labs - San Jose, CA - $180k – $240k/yr
- [Product Manager, Trust & Safety](https://hotfix.jobs/jobs/b9747544-c39a-4e0e-89a3-4e4e35c4eeef) - Mercor - San Francisco, CA - $180k – $300k/yr
- [Product Manager II, Workspace and Multi-User](https://hotfix.jobs/jobs/dc6a8206-0b61-43c6-aad1-ba3749d0634c) - Coinbase - Remote - $180k – $212k/yr
- [Product Manager - Integrations](https://hotfix.jobs/jobs/708203d0-5714-4918-acf3-1dc386f0d8fc) - Fivetran - Oakland, CA - $182k – $218k/yr

**Apply:** https://hotfix.jobs/jobs/8c9dc503-dad7-4931-a4ab-544e906d889e
**Canonical:** https://hotfix.jobs/jobs/8c9dc503-dad7-4931-a4ab-544e906d889e