Skip to content
OpenAIOpenAISan Francisco, CA

Machine Learning Engineer, Distributed Data Systems

Designs and scales distributed data infrastructure for large-scale multimodal AI training and evaluation. Collaborates with researchers to build reliable, high-performance systems in a fast-paced environment.

295k – 445k/yr
HybridML Engineering

About the role

In this role, you will:

  • Design, build, and maintain data infrastructure systems such as distributed compute, data orchestration, distributed storage, streaming infrastructure, machine learning infrastructure while ensuring scalability, reliability, and security.
  • Ensure our data platform can scale by orders of magnitude while remaining reliable and efficient.
  • Partner with researchers to deeply understand requirements and translate them into production-ready systems.
  • Harden, optimize, and maintain critical data infrastructure systems that power multimodal training and evaluation.

You might thrive in this role if you:

  • Have strong experience with distributed systems and large-scale infrastructure with a strong interest in data.
  • Are detail-oriented and bring rigor to building and maintaining reliable systems.
  • Demonstrate excellent software engineering fundamentals and organizational skills.
  • Are comfortable with ambiguity and rapid change.

Skills

Distributed SystemsMachine Learning InfrastructureData OrchestrationDistributed StorageStreaming InfrastructureDistributed ComputeScalable Data Platforms

Similar roles

ML Engineering jobs
OpenAI

Agent Post-Training, API & Power Users

OpenAISan Francisco, CA

Improve agentic model capabilities, reliability, and product fit for power users and API developers through evals, training data, and post-training interventions.

295k – 445k/yr
On-siteML Engineering
OpenAI

Software Engineer, RL Training Infra

OpenAISan Francisco, CA

Build and maintain infrastructure for large-scale RL training runs of frontier OpenAI models. Debug across training, inference, and distributed systems while supporting research integrations.

295k – 445k/yr
HybridML Engineering
OpenAI

Software Engineer, ML Systems & Training Architecture

OpenAISan Francisco, CA

Hands-on senior software engineer focused on maintaining and improving ML training infrastructure, debugging training systems, and unblocking researchers on the robotics team.

295k – 380k/yr
On-site3+ YOEML Engineering
OpenAI

Software Engineer, Inference - Performance Optimization

OpenAISan Francisco, CA

Models inference performance across application, model, and fleet layers using microbenchmarks to build cost-to-serve estimates. Analyzes workloads end-to-end, enhances bottleneck detection tools, and collaborates on optimizations for latency, throughput, and cost.

295k – 555k/yr
On-siteML Engineering
OpenAI

Software Engineer, Inference – AMD GPU Enablement

OpenAISan Francisco, CA

Develops and optimizes OpenAI's inference infrastructure for AMD GPUs, handling low-level kernel performance, distributed execution, and integration with serving frameworks like vLLM and Triton. Requires expertise in GPU programming with HIP/CUDA and distributed systems scaling.

295k – 555k/yr
On-siteML Engineering