# Engineering Manager, ChatGPT Search Infrastructure

**Company:** [OpenAI](https://hotfix.jobs/companies/openai)
**Location:** San Francisco, CA
**Role:** Engineering Management
**Salary:** $401k – $445k/yr
**Experience:** 5+ years
**Skills:** Backend Infrastructure, Platform Engineering, APIs, Distributed Systems, Online Serving, Search Orchestration, Indexing, Information Retrieval, Observability, A/B Testing, Prompt Optimization, Inference Systems, Capacity Planning, Experimentation Platforms, Low-Latency Serving
**Posted:** 2026-09-09

> Leads the engineering team responsible for ChatGPT Search Infrastructure, setting technical direction for scalable, low-latency search platforms and integrations. Requires experience managing senior engineers and deep expertise in distributed systems, online serving, experimentation, and AI-powered products.

## Job Description

## Responsibilities
- Define and drive the technical strategy, architecture, and roadmap for ChatGPT Search Infrastructure across search orchestration, APIs, model and prompt integration, serving, experimentation, evaluation, observability, and product integrations.
- Lead and develop a team of experienced engineers, creating ownership opportunities and fostering an inclusive, high-trust culture with clear accountability.
- Partner with Post-Training on model launches, A/B experiments, search-behavior evaluation, and prompt optimization.
- Build reusable platforms that enable Search product teams to independently implement, test, and launch features with automated reliability, scalability, quality, and latency guardrails.
- Partner with Inference, Indexing, and Retrieval teams to evolve end-to-end Search architecture and improve product outcomes.
- Define and uphold objectives of at least 99.9% availability, sub-second latency where required, and global scalability.
- Establish engineering practices covering system design, testability, observability, experimentation, capacity planning, rollout safety, operational readiness, and incident prevention.
- Lead complex workstreams, remove technical and organizational bottlenecks, and build alignment across product, research, and infrastructure teams.

## Requirements
- Experience managing senior engineers and leading teams responsible for complex, high-scale infrastructure, online serving, or distributed systems.
- Significant technical depth in backend infrastructure, platform engineering, APIs, low-latency serving, experimentation platforms, or AI-powered product development.
- Understanding of how models, prompts, inference systems, search orchestration, indexing, retrieval, and infrastructure work together in an end-to-end user experience.
- Experience partnering with research or Post-Training teams to launch models, run controlled experiments, evaluate model behavior, or optimize prompts in production.
- Experience building shared platforms that enable independent development and launches within reliability, scalability, quality, and performance guardrails.
- Experience shaping systems with demanding availability, latency, and scale requirements, including testability, observability, safe rollout, and operational excellence.
- Ability to balance technical depth, product strategy, organizational leadership, and people management in ambiguous environments.
- Strong cross-functional partnership, judgment, and people-development skills.

## Compensation
- Annual salary: $401,000–$445,000

## Similar jobs

- [Engineering Manager, Client Platform Engineering](https://hotfix.jobs/jobs/5f2c78d0-1072-48ee-8a17-0daa662d561a) - OpenAI - San Francisco, CA - $401k – $445k/yr
- [Engineering Manager, Inference Infrastructure](https://hotfix.jobs/jobs/c7fb9f4a-0b98-48a5-b88d-496ae7e51214) - Anthropic - San Francisco, CA - $405k – $625k/yr
- [Engineering Manager, Artifacts](https://hotfix.jobs/jobs/2d300ca6-e7a9-4a12-bb65-66e373f0cae1) - OpenAI - San Francisco, CA - $347k – $405k/yr
- [Manager, Engineering](https://hotfix.jobs/jobs/79720669-7b3d-48cb-952e-292b11eed5f2) - Garner Health - New York, NY - $310k – $385k/yr
- [Engineering Manager](https://hotfix.jobs/jobs/c9006d33-4b7c-4cce-9af7-898b64c08af4) - Rain - New York, NY - $300k – $400k/yr

**Apply:** https://hotfix.jobs/jobs/8e74e886-d9d3-4e13-9609-23da6400dcb3
**Canonical:** https://hotfix.jobs/jobs/8e74e886-d9d3-4e13-9609-23da6400dcb3