Research Product Manager – AI Systems
Define and build AI evaluation, post-training, and structured data learning systems that improve model performance in production. Partner with researchers and engineers to translate experiments into scalable ML infrastructure.
About the job
Responsibilities
- Define and drive systems for model evaluation, benchmarking, and real-world performance
- Build product direction for post-training systems and feedback loops that continuously improve models
- Define how models learn from large-scale structured and relational datasets
- Partner with engineering to build systems that connect data platforms (warehouses, lakehouses) with ML systems
- Own how improvements move from research experiments into production systems
- Model trade-offs across compute, data efficiency, performance, and cost
- Identify where system improvements drive measurable business impact
Requirements
- 5+ years of experience in product management, technical program management, or similar roles in AI, ML infrastructure, or data systems
- Strong understanding of machine learning systems, including training, evaluation, and deployment
- Experience working with large-scale data systems or distributed infrastructure
- Ability to reason about trade-offs across data, compute, performance, and cost
- Track record of driving complex technical systems from concept to production
Nice-to-Haves
- Experience with ML platforms, LLM systems, or AI infrastructure
- Experience with evaluation systems, observability, or model performance tooling
- Familiarity with structured or relational data systems (e.g., warehouses, lakehouses)
- Background in engineering, applied research, or ML systems development
- Experience operating in research-driven or highly ambiguous environments
Skills
Machine Learning, ML Infrastructure, Model Evaluation, Benchmarking, Post-Training Systems, Structured Data Systems, Data Warehouses, Lakehouses, Distributed Systems, Performance Optimization
Similar jobs
Product Management jobsProduct Manager responsible for driving product strategy, discovery, delivery, and launches for a Network Expansion team focused on location growth. Requires 3+ years of product management experience, strong prioritization and systems-thinking skills, and comfort with high-growth, transaction-based products.
Own the roadmap and execution of a Cash Advance product within a Banking team, shaping lending mechanics, customer conversion, repayment, fees, and unit economics. Requires 3–8 years of relevant consumer lending product experience, strong analytical skills, and effective cross-functional leadership.
Own the strategy, roadmap, quality, and delivery of AI-powered financial agents, balancing customer needs, model capabilities, platform constraints, accuracy, compliance, and trust. Requires 3–7 years of product management experience, hands-on AI or LLM product ownership, agent-quality expertise, and SQL proficiency.
Own the development and growth of OnePay’s consumer subscription product from launch through post-launch optimization. The role requires 3–7 years of product management experience, subscription expertise, and a background in fintech or financial products.
Own the Shared Services roadmap for regulated stablecoin infrastructure, translating compliance-heavy obligations into sequenced product work and coordinating delivery across Engineering, Compliance, and go-to-market teams. The role requires strong product ownership, prioritization, risk management, and stakeholder communication; fintech or compliance experience is preferred.