Software Engineer, Foundations Retrieval
Software Engineer building and scaling retrieval infrastructure for AI models, including indexing, serving, and query execution systems. Partners with researchers to productionize embedding techniques and supports agentic workflows across OpenAI products.
About the job
Responsibilities
- Build and scale retrieval infrastructure across indexing, serving, and query execution.
- Develop low-latency, high-throughput systems for real-time model interaction.
- Partner with research to productionize embedding and retrieval techniques.
- Support dense, sparse, and hybrid retrieval pipelines.
- Own system performance, reliability, and observability at scale.
- Collaborate across Pretraining, Inference, and Product teams to integrate retrieval end-to-end.
- Contribute to model-system interfaces for agentic workflows.
Requirements
- Experience building and scaling distributed systems.
- Background in search, retrieval, or indexing systems.
- Familiarity with embedding-based or ML-powered systems.
- Experience with performance optimization and production reliability.
- Ability to work across ML and systems boundaries.
- First-principles thinking in ambiguous problem spaces.
Skills
Distributed Systems, Search Systems, Retrieval Systems, Indexing Systems, Embeddings, Ml Systems, Performance Optimization, Kubernetes, Low-Latency Systems, High-Throughput Systems
Similar jobs
Backend Engineering jobs
Anthropic
San Francisco, CABuild and scale reliable research infrastructure and distributed systems for evolving AI research workflows. The role independently leads complex technical projects, makes foundational architectural decisions, and partners with researchers and engineering teams.
Thinking Machines Lab
San Francisco, CA
Build and operate secure, scalable sandboxing infrastructure for untrusted, model-generated code and tool calls. The role requires backend programming, virtualization or isolation experience, and strong knowledge of Linux security primitives.
OpenAI
San Francisco, CA
Build backend systems, data infrastructure, agentic workflows, and enterprise integrations that make AI useful and trustworthy for financial institutions. The role requires 5+ years of software engineering experience, backend-language proficiency, and experience with production data-intensive or distributed systems.
OpenAI
San Francisco, CABuild and operate Host Assurance services and host software that establish trust in bare-metal and virtual machine infrastructure through secure bootstrap, identity, attestation, and verification. The role requires production software engineering experience across reliable systems, platform or infrastructure security, and host-system boundaries.
OpenAI
San Francisco, CABuild backend infrastructure and customer-facing workflows that enable developers and AI agents to operate reliably in secure cloud environments. The role requires strong Go and production backend experience, distributed-systems expertise, and practical knowledge of cloud infrastructure, networking, and security.