Staff Product Manager, AI Foundations

Responsibilities

• Own the strategy and roadmap for Vanta’s core AI capabilities, including the agent harness and AI quality and evaluation stack.
• Analyze agent traces to understand customer usage and prioritize high-leverage improvements.
• Build golden datasets, automated evaluators aligned to expert judgment, and self-serve evaluation tooling for product managers, subject-matter experts, and designers.
• Scale the agent harness by shaping core capabilities and balancing cost, latency, reliability, and safety.
• Establish quality standards for evaluations, launch readiness, and observability, and drive adoption across teams.
• Partner with EPD teams and AI pillar teams to turn proven patterns into shared capabilities.
• Help define and shape Vanta’s product team culture.

Requirements

• 8+ years of product management experience, including experience with platform, infrastructure, or technically deep products.
• Hands-on experience building with large language models and AI agents.
• Understanding of how evaluations, observability, and quality signals drive systematic improvement in AI products.
• Strong user empathy and the ability to translate customer problems into product direction.
• Experience operating foundational products with adoption goals, feedback loops, and user-grounded prioritization.
• Credibility with senior engineers and comfort participating in deeply technical design discussions.
• Daily experience using coding agents and curiosity about evolving models and agent tooling.
• Systems-thinking ability across evaluation, observability, and infrastructure choices.
• Ability to thrive in ambiguity and lead with clear problem definition and process.
• Clear written and verbal communication with team members, stakeholders, and executives.
• Curiosity, willingness to learn, and sound judgment in applying AI responsibly.

Compensation and Benefits

• Base salary: $243,000–$286,000.
• Equity.
• Comprehensive medical, dental, and vision coverage, with employee-only premiums covered for most medical plans.
• 16 weeks of paid parental leave for all new parents.
• Health and wellness stipend.
• Remote workspace, internet, and cellphone stipends.
• Commuter benefits for team members reporting to the San Francisco and New York City offices.
• Family planning benefits.
• Matching 401(k) contribution with immediate vesting.
• Flexible paid time off and 80 hours of sick time.
• 11 company-paid holidays.
• Virtual team-building activities, lunch-and-learns, and company-wide events.