Performance Engineer optimizes throughput and robustness of large-scale ML distributed systems by solving novel performance issues. Requires significant software engineering experience at supercomputing scale and interest in ML.
280k – 850k/yr
HybridDevOps / SRE
About the role
You may be a good fit if you:
Have significant software engineering or machine learning experience, particularly at supercomputing scale
Are results-oriented, with a bias towards flexibility and impact
Pick up slack, even if it goes outside your job description
Enjoy pair programming (we love to pair!)
Want to learn more about machine learning research
Care about the societal impacts of your work
Strong candidates may also have experience with:
High performance, large-scale ML systems
GPU/Accelerator programming
ML framework internals
OS internals
Language modeling with transformers
Representative projects:
Implement low-latency high-throughput sampling for large language models
Implement GPU kernels to adapt our models to low-precision inference
Write a custom load-balancing algorithm to optimize serving efficiency
Build quantitative models of system performance
Design and implement a fault-tolerant distributed system running with a complex network topology
Debug kernel-level network latency spikes in a containerized environment
Skills
Machine LearningGpu ProgrammingDistributed SystemsMl FrameworksOs InternalsTransformersKubernetesLoad BalancingPerformance OptimizationHigh-Throughput Systems
Leads incident response operations for product and engineering, serving as on-call commander to coordinate cross-functional teams, manage communications, and improve processes during high-stakes incidents. Requires 5+ years in incident management with technical depth in infrastructure and cloud systems.
290k – 365k/yr
Hybrid5+ YOEDevOps / SRE
Tokens-as-a-Service (Taas) Software Engineer
OpenAISan Francisco, CA +1
Builds systems and tooling to measure, monitor, and optimize token throughput from GPU infrastructure for OpenAI workloads. Integrates partner compute environments, benchmarks performance, analyzes tokenomics, and develops operational metrics and dashboards. Requires strong distributed systems and infrastructure engineering experience.
293k – 455k/yr
HybridDevOps / SRE
SW Engineer, Hardware and System Bring-up/Bootstrapping - Industrial Compute, Scaling
OpenAISeattle, WA
Engineers handle hardware and system bring-up for industrial compute, bootstrapping bare metal nodes into schedulable Kubernetes fleet capacity. Requires 5+ years in Linux infrastructure, IaC tools like Terraform/Chef, and debugging boot/provisioning issues.
293k – 455k/yr
On-site5+ YOEDevOps / SRE
Release Engineer, Consumer Products
OpenAISan Francisco, CA
Designs and operates CI/CD pipelines and release infrastructure for multi-component systems including bootloaders, firmware, and OTA updates. Requires strong automation skills in Python/Bash, Linux expertise, and experience with build systems for embedded/consumer products.
293k – 325k/yr
HybridDevOps / SRE
Networking Operating System Firmware Engineer
OpenAISan Francisco, CA
Develops and maintains custom networking operating system firmware for AI supercomputers, integrating Linux kernel, switch ASICs, and control-plane services. Requires deep expertise in SONiC, SAI, routing protocols, and platform bring-up across hardware and software boundaries.