Skip to content

Software Engineer, Foundations Retrieval

380k – 555kSan Francisco, CAOnsite
Summary

Software Engineer building and scaling retrieval infrastructure for AI models, including indexing, serving, and query execution systems. Partners with researchers to productionize embedding techniques and supports agentic workflows across OpenAI products.

About the role

Responsibilities

  • Build and scale retrieval infrastructure across indexing, serving, and query execution.
  • Develop low-latency, high-throughput systems for real-time model interaction.
  • Partner with research to productionize embedding and retrieval techniques.
  • Support dense, sparse, and hybrid retrieval pipelines.
  • Own system performance, reliability, and observability at scale.
  • Collaborate across Pretraining, Inference, and Product teams to integrate retrieval end-to-end.
  • Contribute to model-system interfaces for agentic workflows.

Requirements

  • Experience building and scaling distributed systems.
  • Background in search, retrieval, or indexing systems.
  • Familiarity with embedding-based or ML-powered systems.
  • Experience with performance optimization and production reliability.
  • Ability to work across ML and systems boundaries.
  • First-principles thinking in ambiguous problem spaces.
Skills
Distributed SystemsSearch SystemsRetrieval SystemsIndexing SystemsEmbeddingsML SystemsPerformance OptimizationKubernetesLow-Latency SystemsHigh-Throughput Systems
Similar roles at this salary range
All Backend Engineering jobs →
Anthropic

Staff + Senior Software Engineer, Cloud Inference

The Cloud Inference team is seeking Staff/Senior Software Engineers to scale and optimize Claude across multiple cloud service providers. This role involves designing, building, and owning backend services and infrastructure, collaborating cross-functionally, and ensuring reliable and cost-effective inference management at massive scale.

320k – 485kSan Francisco, CABackend EngineeringHybridRustCI/CD
Thinking Machines Lab

Software Engineer, Platform, Tinker

Builds platform systems for AI fine-tuning API including billing, metering, authorization (RBAC/OAuth), organizations/teams, data exports, and audit logging. Requires backend proficiency in Python/Rust and experience in billing, access control, or multi-tenant systems; bachelor's or equivalent.

350k – 475kSan Francisco, CA +1Backend EngineeringOn-siteSSORust
Anthropic

Staff+ Software Engineer, Backend

Staff backend engineer owns scalable systems for Anthropic's API, Claude.ai, and developer tools across teams like API Core and Enterprise Foundations. Requires 8+ years experience leading complex projects, distributed systems, and cross-team alignment in fast-paced AI environment.

405k – 485kSan Francisco, CA +2Backend EngineeringHybridGoAWS
OpenAI

Principal Software Engineer, B2B Engineering

Leads architecture and scaling of backend services, APIs, distributed systems, databases, and data pipelines for OpenAI's developer platform and enterprise products. Requires deep expertise in backend engineering, reliability, security, and cross-team collaboration in fast-paced environments.

385k – 490kSan Francisco, CABackend EngineeringOn-siteGoRust
Anthropic

Staff Software Engineer, Billing Platform

Builds and operates billing platform infrastructure to convert product usage into reliable revenue, focusing on pricing, payments, contracts, and data integrity. Requires 8+ years backend/platform experience, cross-functional collaboration with Finance/Product/Sales, and emphasis on correctness in financial systems.

320k – 405kSan Francisco, CA +1Backend EngineeringHybridCPQAPIs