Principal Product Manager, Experimentation Platform
Leads strategy and roadmap development for a shared experimentation platform, partnering with Machine Learning, Analytics, Engineering, and product teams to improve experimentation rigor and scale AI and product workflows. Requires 7+ years of product management experience and expertise with technical platforms and quantitative methods.
About the job
Responsibilities
- Define and drive the strategy and roadmap for Upstart’s experimentation platform, balancing immediate business needs with a scalable long-term vision.
- Collaborate with Machine Learning, Analytics, and Engineering teams to build shared experimentation capabilities for randomized experiments, model deployments, feature flags, and emerging experimentation patterns.
- Create common abstractions and guardrails that reduce fragmentation, improve experimentation quality, and enable product and engineering teams to test and learn more effectively.
- Establish an experimentation center of excellence by defining standards, improving rigor, and enabling adoption of effective practices across the company.
- Partner with Growth, Servicing, Capital, and other stakeholder teams to understand needs, prioritize opportunities, and drive adoption of shared capabilities.
- Guide experimentation technology and vendor-partnership decisions, evaluating external solutions versus internally developed capabilities.
Requirements
- Bachelor’s degree in Computer Science, Engineering, Mathematics, Statistics, or a related field, or equivalent practical experience.
- 7+ years of product management experience.
- Experience owning strategy and roadmaps for technically complex software, platform, infrastructure, data, or developer-facing products.
- Experience partnering with Engineering, Data Science, Machine Learning, or Analytics teams on product architecture, tradeoffs, and delivery.
- Experience applying quantitative methods, including statistics, experimentation, analytics, or data science, to product development and decision-making.
- Experience developing platforms supporting Machine Learning or AI workflows, including deployment, measurement, or experimentation.
Nice-to-haves
- Experience building or leading an experimentation platform product within a consumer technology company or experimentation technology provider.
- Knowledge of randomized experiments, feature flags, model experimentation, metric design, and statistical evaluation.
- Ability to connect shared technical capabilities to broader company and product priorities.
- Ability to communicate complex technical and quantitative concepts to engineers, data scientists, and senior leaders.
- Ability to build alignment across multiple product and technical teams and establish shared practices in a distributed organization.
Compensation and benefits
- Anticipated base salary: $187,900–$260,000 USD, varying by geographic compensation region.
- Target bonuses, equity compensation, and annual equity grants.
- Medical, dental, vision, wellness, retirement, paid time off, family and parental leave, financial wellness, and employee assistance benefits.
Skills
Product Strategy, Roadmapping, Experimentation, Machine Learning, Artificial Intelligence, Statistics, Analytics, Data Science, Feature Flags, Model Deployment, Platform Architecture, Vendor Management
Similar jobs
Product Management jobsOwn strategy and execution for a high-impact capital platform domain, building scalable systems for lenders and investors. The role requires 7+ years of product management experience, Staff/Principal-level scope, technical fluency, and experience with complex regulated workflows.
Own the vision, strategy, roadmap, vendor ecosystem, and commercialization of a company-wide payments platform. Requires 10+ years of product management experience, deep payments expertise, and strong cross-functional leadership in regulated environments.
Leads product strategy and delivery for AI-powered tax agents, partnering with engineers, designers, and tax practitioners to launch and scale enterprise products. Requires 8+ years of product management experience, deep AI/agent expertise, and at least 3 years in tax.
Leads the development of AI agents and products that transform financial audit workflows, partnering closely with engineers, strategic customers, and cross-functional teams. Requires 7+ years of product management experience and a track record building production agentic systems.
Leads strategy and execution for GitLab’s custom-model and self-hosted AI capabilities, balancing model flexibility, agent orchestration, infrastructure, deployment, and hardware needs. Requires principal-level product leadership experience in AI, infrastructure, technical platforms, or adjacent developer-focused products.