Product Manager, Model Gateway

What You’ll Do

• Own the LLM gateway end-to-end: Set the roadmap and policy for the shared layer that routes every product surface to the models it depends on, from priority queueing to cost attribution to model access, and own its lifecycle from conception through execution.
• Design priority and fairness: Define the queueing and rate-limiting logic that decides whose workload runs when, balancing revenue blocking traffic against background jobs, and making the tradeoffs explicit and consistent.
• Make cost visible and attributable: Work backwards from business outcomes to make product decisions that impact business health and growth.
• Negotiate rate limits and usage policy: Turn contention over shared capacity into clear, defensible rules people can plan around.
• Partner with infrastructure: Work hand-in-hand with the central infra team translating product needs into platform requirements and platform constraints back into product tradeoffs.
• Work backwards from the business: Connect gateway decisions to business health, cost, reliability, and velocity, and use that to prioritize.

What We’re Looking For

• 5+ years as a product manager, ideally on platform, infrastructure, or developer-facing products; prior background in SWE, ML, or DS strongly preferred.
• Systems thinking: You reason fluently about queues, rate limits, quotas, and the tradeoffs between latency, throughput, and cost, and you can turn those tradeoffs into policy.
• High ownership: You take full accountability for outcomes not just outputs.
• Independence: Able to self-direct in ambiguous, cross-cutting contexts.
• Technical fluency: Comfortable reading usage data, writing queries, and building scrappy dashboards or making small PRs to validate direction and unblock engineering.
• Stakeholder alignment: You can bring many product teams around shared constraints and turn contention over capacity and spend into rules people accept and plan around.
• Cost & metrics orientation: Comfortable with cost models, unit economics, and attribution, and equally able to push forward a longer-term platform vision.

Benefits

• Bi-annual performance bonus structure
• Generous equity grant vested over 4 years
• Up to $15k Relocation bonus
• $10K housing bonus (if you live within 0.5 miles of our office)
• $1.5K monthly stipend for meals
• Free Equinox membership
• $200 monthly laundry reimbursement
• $200 monthly personal wellness reimbursement
• Health, Dental, Vision insurance