# Technical Product Manager

**Company:** [Alluxio](https://hotfix.jobs/companies/alluxio)
**Location:** Foster City, CA
**Role:** Product Management
**Experience:** 5+ years
**Skills:** PyTorch, TensorFlow, Ray, Triton, Kubernetes, AWS, GCP, Azure, LangChain, Distributed Systems, Caching
**Posted:** 2025-08-22

> Defines and executes AI systems strategy for Alluxio's data platform, focusing on inference, training, and agentic workloads. Collaborates with engineering and AI teams to optimize latency, throughput, and integrations with frameworks like PyTorch and Ray. Requires 5-9 years in AI infrastructure or ML platforms.

## Job Description

## What You'll Own

- **AI Product Strategy** — define the long-term vision and roadmap for Alluxio’s AI data platform, covering inference, training, and agentic workloads.
- **Systems Optimization for AI** — collaborate with engineering to design features that deliver high-throughput, low-latency data access (e.g., GPU-aware caching, streaming reads, tiered prefetching).
- **AI Ecosystem Integration** — ensure seamless integration with frameworks like PyTorch, TensorFlow, Ray, and Triton; evolve Alluxio’s APIs for AI-native workloads.
- **Customer & Partner Collaboration** — engage directly with enterprise AI teams to understand workload patterns, validate impact, and prioritize roadmap direction.
- **Market Awareness & Foresight** — stay ahead of trends in multi-model serving, retrieval-augmented generation (RAG), and agentic orchestration; translate them into actionable product plans.

## What We’re Looking For

- 5–9 years of experience in product management or technical leadership within AI infrastructure, ML platforms, or distributed systems.
- Strong understanding of AI/ML workflows — from model training and deployment to inference and data-access pipelines.
- Proven track record of delivering infrastructure features that improve latency, GPU utilization, or total cost of ownership.
- Technical fluency with distributed systems, caching, and cloud orchestration (Kubernetes, AWS/GCP/Azure).
- Familiarity with AI frameworks such as PyTorch, TensorFlow, Triton, Ray, or LangChain.
- Exceptional communication and strategic thinking — ability to translate complex systems work into clear, prioritized roadmaps.

## Similar roles

- [Product Manager III](https://hotfix.jobs/jobs/5e98e644-8832-4a89-9bb3-600fb6c58c22) - Garner Health - New York, NY - $180k – $205k/yr
- [Product Manager](https://hotfix.jobs/jobs/e4265415-cd30-4a37-ad0c-443b9fbd48c1) - Airtable - San Francisco, CA - $187k – $235k/yr
- [Product Manager II](https://hotfix.jobs/jobs/89d3f7ae-485d-47fa-9a3a-58d7f820ca47) - Datadog - New York, NY - $156k – $195k/yr
- [Product Manager, Cash Platform](https://hotfix.jobs/jobs/cc0d6044-f81c-4402-bb92-661492a7ff43) - Stripe - New York, NY
- [AI Product Manager, Professional Services](https://hotfix.jobs/jobs/5e0a432e-2dac-4b20-8a64-99efffc735d5) - Stripe - New York, NY

**Apply:** https://hotfix.jobs/jobs/d610c026-5ff6-473f-a35b-65ea7f1eb61b
**Canonical:** https://hotfix.jobs/jobs/d610c026-5ff6-473f-a35b-65ea7f1eb61b