Engineering Manager, Model Flywheel
Lead engineering efforts to enhance ChatGPT model capabilities through improved experimentation, safe deployment, measurement systems, and multi-tier experiences. Requires proven leadership in scaling AI or large backend production systems with cross-functional collaboration.
About the job
Responsibilities
- Elevate and consolidate ChatGPT’s harness, context management, and system prompt frameworks.
- Drive expansion and improvement of multi-tier model experiences.
- Support and scale self-serve experiment capabilities and automated guardrails.
- Lead model rollout automation, capacity management, and health monitoring.
- Shape end-to-end measurement systems (evals, grader signals, user feedback, etc.).
Requirements
- Proven experience leading engineering teams in complex, cross-functional environments.
- Demonstrated success shipping production systems at scale (ideally for AI or large backend services).
- Deep understanding of model-driven product development, deployment lifecycle, and measurement tooling.
- Excellent communication and collaboration skills—experience interfacing directly with engineering, research, and product stakeholders.
Nice-to-Haves
- Prior involvement with large language models, distributed infrastructure, or experimentation platforms.
Skills
LLMs, Model Deployment, Experimentation Platforms, Distributed Infrastructure, Ai Systems, Measurement Tooling, Evaluation Systems, Capacity Management, Health Monitoring
Similar jobs
Engineering Management jobs
OpenAI
San Francisco, CA
Leads and grows infrastructure engineering teams responsible for highly reliable, large-scale distributed systems and core production platforms. The role requires experience operating mission-critical services, building platform or storage infrastructure across multiple clouds, and strong technical and people leadership.
Parafin
San Francisco, CA
Leads and remains hands-on with a 5–6-person team building data platform, ML infrastructure, and underwriting systems that power capital offers. Requires 5+ years of software engineering experience, technical leadership or management experience, and expertise in modern data and cloud infrastructure.
Rain
New York, NY
Leads and develops senior backend and platform engineers while owning architecture, reliability, and technical standards for systems moving money globally. The role requires at least five years of leadership-level experience, current hands-on engineering, distributed systems expertise, and high-stakes payments or fintech experience.
Decagon
San Francisco, CALeads and grows a research engineering team developing and productionizing conversational AI models and agent systems. The role requires substantial machine-learning systems experience, foundation-model expertise, and people-management experience.
Garner Health
New York, NY
Leads the Data Platform Engineering team, building scalable batch and streaming infrastructure for complex healthcare data while guiding architecture, operations, and team development. Requires 5+ years of engineering experience and 2+ years managing engineering teams.