Skip to content

Product Manager, AI Infrastructure

175k – 220kSan Francisco, CAProduct ManagementOnsite5+ YOE
Summary

Own day-to-day product work for AI infrastructure (GPU clusters, storage, observability). Drive experiments, find and resolve problems with high agency, and grow into full ownership of a product area. Requires strong data skills and technical foundation.

About the role

Responsibilities

  • Own the day-to-day product and feature work across Together's AI infrastructure products - GPU Clusters, Managed Storage, and observability - with an early focus on observability and storage.
  • Find and drive problems to resolution with minimal guidance, including issues that aren't yet on anyone's radar.
  • Run structured, hypothesis-driven experiments - reading the data yourself and driving the data collection and instrumentation needed to answer open questions.
  • Partner across engineering, product, and partner teams to ship improvements and unblock work without waiting for permission.
  • Translate a deep understanding of customers operating in fast-moving, high-ambiguity markets into product decisions.
  • Juggle multiple priorities and workstreams across a broad infrastructure surface.
  • Grow into end-to-end ownership of a complete product area (observability or storage) as you ramp.

Requirements

  • Deep empathy for customers operating in high-ambiguity, fast-evolving markets; we work with AI Native startups and model labs that move at high pace.
  • Strong, hands-on data and analytics skills with a hypothesis-driven approach - you design experiments, read the data yourself, and can drive the data collection needed to get answers.
  • High agency: you find problems, push through resistance, and drive resolution without waiting to be told what to do.
  • A real technical foundation - whether from an AI/infrastructure background, hands-on software development, or strong working knowledge of cloud and infrastructure.
  • A track record of collaborating across orgs and product lines to get things done.
  • Comfortable managing multiple priorities and workstreams at once.
  • Familiarity with the AI stack, especially at the infrastructure layer, is a strong plus.
  • Cloud platform experience (AWS, Azure, GCP, or similar) - with extra weight if you've helped build such products.
  • Bonus: working knowledge of the Nvidia/AMD GPU stack (InfiniBand, NCCL, GPU operator, etc.), or experience with AI training or inference workloads.

Compensation & Benefits

  • US base salary range: $175,000 - $220,000 + equity + benefits.
Skills
Product ManagementData AnalyticsHypothesis-Driven ExperimentationCloud Platforms (AWS, Azure, GCP)AI InfrastructureGPU ClustersObservabilityTechnical CollaborationInfrastructure KnowledgeNVIDIA/AMD GPU Stack
Similar roles at this salary range
All Product Management jobs →
Linktree

Senior Product Manager, Mobile

Own strategy and roadmap for Linktree’s native iOS and Android apps. Partner with design and engineering to ship mobile-native experiences and drive metrics beyond feature parity.

180k – 210kLos Angeles, CA +1Product ManagementHybrid4+ YOEiOSAndroid
Fivetran

Product Manager - Integrations

Owns the health and management of a portfolio of SaaS data connectors. Partners with engineering and customers to prioritize features, manage backlog, and resolve incidents.

182k – 218kOakland, CAProduct ManagementHybridSQLAgile
Scale AI

Senior AI Product Manager, Healthcare Agents

Own the Healthcare vertical for AI agent training environments and data products. Partner with frontier labs to build realistic healthcare workflow simulations and datasets that train agents on real clinical and revenue-cycle tasks.

206k – 257kSan Francisco, CA +2Product ManagementOn-site2+ YOEEHR SystemsRoadmapping
Instacart

Principal Product Manager, AI

Own vision, roadmap, and GTM for agentic AI products that help retailers recover margin by tackling out-of-stocks, shrink, waste, and fulfillment. Requires 6+ years PM experience with 3+ years shipping AI/ML products to enterprise customers.

209k – 264kUnited StatesProduct ManagementRemote6+ YOESQLPRDs
Instacart

Senior Product Manager, AI

Own vision, roadmap, and GTM for agentic AI products that help retailers recover margin by tackling out-of-stocks, shrink, and fulfillment issues. Requires 6+ years PM experience with 3+ years shipping AI/ML products to enterprise customers.

184k – 233kUnited StatesProduct ManagementRemote6+ YOESQLPRDs