Performance Engineer optimizes infrastructure and application performance for ChatGPT and OpenAI API, focusing on latency, throughput, and efficiency at scale. Requires 7+ years in high-scale systems with expertise in profiling, tracing, and cross-layer optimizations.
325k – 405k/yr
Remote7+ YOEDevOps / SRE
About the role
Responsibilities
Analyze and optimize performance across application, middleware, runtime, and infrastructure layers—networking, storage, Python runtime, GPU utilization, and beyond.
Develop tooling and metrics that provide deep observability into system performance.
Collaborate closely with infra, platform, training, and product teams to identify key performance goals and drive systemic improvements.
Influence architecture and design decisions to prioritize latency, throughput, and efficiency at scale.
Lead investigations into high-impact performance regressions or scalability issues in production.
Drive performance testing strategies and help define SLAs/SLOs around latency and throughput for critical systems.
Requirements
7+ years of experience in software engineering with a strong track record in performance or reliability of high-scale distributed systems.
Deeply comfortable with performance profiling tools and tracing systems.
Experience optimizing performance across one or more layers of the stack (e.g., database, networking, storage, application runtime, GC tuning, Python/Golang internals, GPU utilization).
Strong understanding of OS internals, scheduling, memory management, and IO patterns.
Contributed to observability, benchmarking, or performance-focused infrastructure at scale.
Demonstrated success navigating ambiguity and aligning stakeholders around performance goals.
Value simplicity, rigor, and collaboration when solving complex systems problems.
Designs and builds scalable cloud infrastructure platforms powering OpenAI's consumer products, focusing on Kubernetes orchestration, reliability, and growth. Requires 8+ years experience leading large-scale systems with strong systems thinking.
Lead deployment and operations for OpenAI’s custom silicon and systems into data center environments. Drive hardware bring-up, validation, production deployment, and fleet reliability at scale while leading a technical team.
342k – 445k/yr
Hybrid8+ YOEDevOps / SRE
CPU Storage Tech Lead
OpenAISan Francisco, CA +1
Leads technical strategy for CPU platforms, memory, and storage architectures in large-scale AI data centers. Evaluates vendor roadmaps, drives platform decisions, and ensures optimization for AI training and inference with 10+ years experience in server hardware and hyperscale infrastructure.
342k – 555k/yr
Hybrid10+ YOEDevOps / SRE
CPU/Storage/PoP-WAN Program Manager
OpenAISan Francisco, CA +1
Leads execution of CPU, storage, PoP, and WAN infrastructure programs to activate compute clusters and expand global networks. Requires 8+ years in technical program management with deep knowledge of hardware, networking, and data center deployments.
342k – 555k/yr
Hybrid8+ YOEDevOps / SRE
Senior Software Engineer, Infrastructure
OpenAIBellevue, WA +1
Builds and scales infrastructure for OpenAI's experimentation platform, including low-latency configuration delivery, high-throughput data ingestion, and analytics systems handling billions of evaluations. Requires expertise in large-scale distributed systems, performance optimization, and operational excellence.