Skip to content
OpenAIOpenAISan Francisco, CA

Software Engineer, Caching Infrastructure

Design, build, and operate a multi-tenant caching platform powering OpenAI's inference, identity, and products. Requires 5+ years in distributed systems with deep Redis/Memcached expertise and Kubernetes experience.

230k – 385k/yr
On-site5+ YOEDevOps / SRE

About the role

In This Role, You Will:

  • Design, build, and operate OpenAI’s multi-tenant caching platform used across inference, identity, quota, and product experiences.
  • Define the long-term vision and roadmap for caching as a core infra capability, balancing performance, durability, and cost.
  • Collaborate with other infra teams (e.g., networking, observability, databases) and product teams to ensure our caching platform meets their needs.

You Might Thrive In This Role If You:

  • Have 5+ years of experience building and scaling distributed systems, with a strong focus on caching, load balancing, or storage systems.
  • Have deep expertise with Redis, Memcached or similar solutions, including clustering, durability configurations, client-side connection patterns, and performance tuning.
  • Have production experience with Kubernetes, service meshes (e.g., Envoy), and autoscaling systems.
  • Think rigorously about latency, reliability, throughput, and cost in designing platform capabilities.
  • Thrive in a fast-paced environment and enjoy balancing pragmatic engineering with long-term technical excellence.

Skills

RedisMemcachedKubernetesEnvoyDistributed SystemsCachingLoad BalancingAutoscalingNetworkingStorage Systems

Similar roles

DevOps / SRE jobs
OpenAI

Software Engineer, Productivity - Inference Runtime

OpenAISan Francisco, CA

Builds and improves CI/CD, testing, validation, and release tooling for OpenAI's inference runtime teams to ensure reliable, performant model deployments across ChatGPT, API, and research workloads. Requires strong Python skills, developer productivity experience, and high ownership in ambiguous environments.

230k – 385k/yr
On-siteDevOps / SRE
OpenAI

Software Engineer, Core Network Engineering

OpenAISan Francisco, CA

Builds and operates high-performance networking infrastructure for OpenAI's large-scale AI training and inference, focusing on host networking, datacenter fabrics, and WAN systems. Optimizes latency, reliability, and scalability using technologies like RDMA, InfiniBand, and RoCE; requires strong systems programming in C++, Python, or Go.

230k – 342k/yr
On-siteDevOps / SRE
OpenAI

Software Engineer, Productivity - Model Performance

OpenAISan Francisco, CA

Builds and improves developer tools, CI/CD pipelines, and testing workflows to boost productivity for OpenAI's model performance engineering teams. Requires strong Python skills, experience with developer infrastructure, and ability to work in ambiguous environments.

230k – 385k/yr
On-siteDevOps / SRE
OpenAI

Software Engineer, Productivity - Networking

OpenAISan Francisco, CA

Enhances developer productivity for OpenAI's networking team by improving build systems, CI/CD pipelines, test harnesses, and workflows for C++ and Python codebases in multi-server environments. Requires experience with developer tools and infrastructure automation.

230k – 385k/yr
On-siteDevOps / SRE
OpenAI

Software Engineer, Compute Infrastructure

OpenAISan Francisco, CA +2

Builds and optimizes large-scale compute infrastructure for AI workloads, spanning hardware automation, distributed systems, Kubernetes orchestration, networking, storage, and developer tools. Requires strong systems engineering experience in performance, reliability, and production infrastructure.

230k – 405k/yr
HybridDevOps / SRE