Software Engineer building and scaling retrieval infrastructure for AI models, including indexing, serving, and query execution systems. Partners with researchers to productionize embedding techniques and supports agentic workflows across OpenAI products.
380k – 555k/yr
On-siteBackend Engineering
About the role
Responsibilities
Build and scale retrieval infrastructure across indexing, serving, and query execution.
Develop low-latency, high-throughput systems for real-time model interaction.
Partner with research to productionize embedding and retrieval techniques.
Support dense, sparse, and hybrid retrieval pipelines.
Own system performance, reliability, and observability at scale.
Collaborate across Pretraining, Inference, and Product teams to integrate retrieval end-to-end.
Contribute to model-system interfaces for agentic workflows.
Requirements
Experience building and scaling distributed systems.
Background in search, retrieval, or indexing systems.
Familiarity with embedding-based or ML-powered systems.
Experience with performance optimization and production reliability.
Ability to work across ML and systems boundaries.
First-principles thinking in ambiguous problem spaces.
Skills
Distributed SystemsSearch SystemsRetrieval SystemsIndexing SystemsEmbeddingsMl SystemsPerformance OptimizationKubernetesLow-Latency SystemsHigh-Throughput Systems
Designs and implements custom networking collectives using C++ and CUDA for efficient AI model training on supercomputers. Requires expertise in low-level performance-critical software, RDMA distributed algorithms, and GPU/CPU code.
380k – 555k/yr
HybridBackend Engineering
Software Engineer, ChatGPT Infrastructure
OpenAISan Francisco, CA
Design and build infrastructure platforms for ChatGPT, focusing on scalability, reliability, and developer productivity. Requires experience with large-scale distributed systems, performance optimization, and creating reusable abstractions for engineering teams.
255k – 405k/yr
On-siteBackend Engineering
Backend Software Engineer
RecallSan Francisco, CA
Develops high-performance APIs and real-time video processing pipelines for massive-scale infrastructure handling 3TB/second data. Requires 4+ years systems software experience, customer empathy, and ability to independently own features in a fast-growing startup.
235k – 235k/yr
On-site4+ YOEBackend Engineering
Software Engineer, Codex -Enterprise Controls
OpenAISan Francisco, CA
Build and operate the enterprise control plane for OpenAI's Codex AI software engineer, focusing on security, governance, identity, access controls, encryption, and policy enforcement systems for large organizations.
230k – 385k/yr
Hybrid5+ YOEBackend Engineering
Software Engineer, Private Computing
OpenAISan Francisco, CA
Design, build, and scale privacy features and infrastructure for ChatGPT, API, and consumer devices using confidential computing and encryption. Requires 5+ years of software engineering experience and production experience with trusted execution environments.