Design, build, and operate a multi-tenant caching platform powering OpenAI's inference, identity, and products. Requires 5+ years in distributed systems with deep Redis/Memcached expertise and Kubernetes experience.
230k – 385k/yr
On-site5+ YOEDevOps / SRE
About the role
In This Role, You Will:
Design, build, and operate OpenAI’s multi-tenant caching platform used across inference, identity, quota, and product experiences.
Define the long-term vision and roadmap for caching as a core infra capability, balancing performance, durability, and cost.
Collaborate with other infra teams (e.g., networking, observability, databases) and product teams to ensure our caching platform meets their needs.
You Might Thrive In This Role If You:
Have 5+ years of experience building and scaling distributed systems, with a strong focus on caching, load balancing, or storage systems.
Have deep expertise with Redis, Memcached or similar solutions, including clustering, durability configurations, client-side connection patterns, and performance tuning.
Have production experience with Kubernetes, service meshes (e.g., Envoy), and autoscaling systems.
Think rigorously about latency, reliability, throughput, and cost in designing platform capabilities.
Thrive in a fast-paced environment and enjoy balancing pragmatic engineering with long-term technical excellence.
Skills
RedisMemcachedKubernetesEnvoyDistributed SystemsCachingLoad BalancingAutoscalingNetworkingStorage Systems
Builds and improves CI/CD, testing, validation, and release tooling for OpenAI's inference runtime teams to ensure reliable, performant model deployments across ChatGPT, API, and research workloads. Requires strong Python skills, developer productivity experience, and high ownership in ambiguous environments.
230k – 385k/yr
On-siteDevOps / SRE
Software Engineer, Core Network Engineering
OpenAISan Francisco, CA
Builds and operates high-performance networking infrastructure for OpenAI's large-scale AI training and inference, focusing on host networking, datacenter fabrics, and WAN systems. Optimizes latency, reliability, and scalability using technologies like RDMA, InfiniBand, and RoCE; requires strong systems programming in C++, Python, or Go.
230k – 342k/yr
On-siteDevOps / SRE
Software Engineer, Productivity - Model Performance
OpenAISan Francisco, CA
Builds and improves developer tools, CI/CD pipelines, and testing workflows to boost productivity for OpenAI's model performance engineering teams. Requires strong Python skills, experience with developer infrastructure, and ability to work in ambiguous environments.
230k – 385k/yr
On-siteDevOps / SRE
Software Engineer, Productivity - Networking
OpenAISan Francisco, CA
Enhances developer productivity for OpenAI's networking team by improving build systems, CI/CD pipelines, test harnesses, and workflows for C++ and Python codebases in multi-server environments. Requires experience with developer tools and infrastructure automation.
230k – 385k/yr
On-siteDevOps / SRE
Software Engineer, Compute Infrastructure
OpenAISan Francisco, CA +2
Builds and optimizes large-scale compute infrastructure for AI workloads, spanning hardware automation, distributed systems, Kubernetes orchestration, networking, storage, and developer tools. Requires strong systems engineering experience in performance, reliability, and production infrastructure.