Engineering Manager, ChatGPT Search Infrastructure
Leads the engineering team responsible for ChatGPT Search Infrastructure, setting technical direction for scalable, low-latency search platforms and integrations. Requires experience managing senior engineers and deep expertise in distributed systems, online serving, experimentation, and AI-powered products.
About the job
Responsibilities
- Define and drive the technical strategy, architecture, and roadmap for ChatGPT Search Infrastructure across search orchestration, APIs, model and prompt integration, serving, experimentation, evaluation, observability, and product integrations.
- Lead and develop a team of experienced engineers, creating ownership opportunities and fostering an inclusive, high-trust culture with clear accountability.
- Partner with Post-Training on model launches, A/B experiments, search-behavior evaluation, and prompt optimization.
- Build reusable platforms that enable Search product teams to independently implement, test, and launch features with automated reliability, scalability, quality, and latency guardrails.
- Partner with Inference, Indexing, and Retrieval teams to evolve end-to-end Search architecture and improve product outcomes.
- Define and uphold objectives of at least 99.9% availability, sub-second latency where required, and global scalability.
- Establish engineering practices covering system design, testability, observability, experimentation, capacity planning, rollout safety, operational readiness, and incident prevention.
- Lead complex workstreams, remove technical and organizational bottlenecks, and build alignment across product, research, and infrastructure teams.
Requirements
- Experience managing senior engineers and leading teams responsible for complex, high-scale infrastructure, online serving, or distributed systems.
- Significant technical depth in backend infrastructure, platform engineering, APIs, low-latency serving, experimentation platforms, or AI-powered product development.
- Understanding of how models, prompts, inference systems, search orchestration, indexing, retrieval, and infrastructure work together in an end-to-end user experience.
- Experience partnering with research or Post-Training teams to launch models, run controlled experiments, evaluate model behavior, or optimize prompts in production.
- Experience building shared platforms that enable independent development and launches within reliability, scalability, quality, and performance guardrails.
- Experience shaping systems with demanding availability, latency, and scale requirements, including testability, observability, safe rollout, and operational excellence.
- Ability to balance technical depth, product strategy, organizational leadership, and people management in ambiguous environments.
- Strong cross-functional partnership, judgment, and people-development skills.
Compensation
- Annual salary: $401,000–$445,000
Skills
Backend Infrastructure, Platform Engineering, APIs, Distributed Systems, Online Serving, Search Orchestration, Indexing, Information Retrieval, Observability, A/B Testing, Prompt Optimization, Inference Systems, Capacity Planning, Experimentation Platforms, Low-Latency Serving
Similar jobs
Engineering Management jobs
OpenAI
San Francisco, CALeads the client platform engineering organization responsible for secure, reliable endpoint services across major operating systems. The role combines people management, platform strategy, architecture oversight, operational excellence, and cross-functional partnership.
Anthropic
San Francisco, CALeads teams building and operating the control plane for Anthropic’s large-scale inference fleet, improving routing, capacity, performance, reliability, and cost. Requires deep production-systems expertise, engineering management experience, and strong cross-functional leadership.
OpenAI
San Francisco, CA
Leads and grows the engineering team building AI-native artifacts such as documents, spreadsheets, slides, and dashboards. The role sets technical direction across product, infrastructure, rendering, storage, reliability, and model integration while partnering closely with research and product teams.
Garner Health
New York, NY
Leads the Data Platform Engineering team, building scalable batch and streaming infrastructure for complex healthcare data while guiding architecture, operations, and team development. Requires 5+ years of engineering experience and 2+ years managing engineering teams.
Rain
New York, NY
Leads and develops senior backend and platform engineers while owning architecture, reliability, and technical standards for systems moving money globally. The role requires at least five years of leadership-level experience, current hands-on engineering, distributed systems expertise, and high-stakes payments or fintech experience.