Skip to content
OpenAIOpenAISan Francisco, CA

Software Engineer, Data Infrastructure - Research

Designs and implements dataset infrastructure for OpenAI's large-scale LLM training stack, including standardized APIs for multimodal data, scaling pipelines across GPU fleets, and performance debugging. Requires strong distributed systems experience and collaboration with researchers.

250k – 380k
On-siteData Engineering

About the role

Responsibilities

  • Design and maintain standardized dataset APIs, including for multimodal (MM) data that cannot fit in memory.
  • Build proactive testing and scale validation pipelines for dataset loading at GPU scale.
  • Collaborate with teammates to integrate datasets seamlessly into training and inference pipelines, ensuring smooth adoption and a great user experience.
  • Document and maintain dataset interfaces so they are discoverable, consistent, and easy for other teams to adopt.
  • Establish safeguards and validation systems to ensure datasets remain reproducible and unchanged once standardized.
  • Debug and resolve performance bottlenecks in distributed dataset loading (e.g., straggler systems slowing global training).
  • Provide visualization and inspection tools to surface errors, bugs, or bottlenecks in datasets.

Requirements

  • Strong engineering fundamentals with experience in distributed systems, data pipelines, or infrastructure.
  • Experience building APIs, modular code, and scalable abstractions, while recognizing that abstractions ultimately serve the users and UX is an important part of the abstractions design.
  • Comfortable debugging bottlenecks across large fleets of machines.
  • Take pride in building infrastructure that “just works,” and find joy in being the guardian of reliability and scale.
  • Collaborative, humble, and excited to own a foundational (if not glamorous) part of the ML stack.

Nice-to-Haves

  • Background knowledge in data math, probability, or distributed data theory.
  • Worked with GPU-scale distributed systems or dataset scaling for real-time data.

Skills

Distributed SystemsData PipelinesAPIsGPUPyTorchKubernetesPythonRustScalable AbstractionsDataset Loading
The Voleon Group

Software Engineer, Data Infrastructure

The Voleon GroupNew York, NY +1

Software Engineer building scalable data infrastructure, cataloging, versioning, and lineage tools to support ML research and production workflows at an AI-driven hedge fund. Requires 3+ years experience, strong software design skills, and expertise in a modern language like Python or Java.

235k – 300k
Remote3+ YOEData Engineering
Anthropic

Data Operations Manager, Human Data

AnthropicSan Francisco, CA +1

Data Operations Manager responsible for building and scaling data strategies, vendor partnerships, and high-quality data pipelines to advance frontier AI research in RLHF, safety, tool use, and agentic systems at Anthropic. Requires 3+ years operations/PM experience, strong project management, data analysis skills, and passion for AI safety.

270k – 365k
Hybrid3+ YOEData Engineering
OpenAI

Software Engineer, Distributed Data Systems (Sora)

OpenAISan Francisco, CA

Designs and scales distributed data infrastructure for large-scale multimodal training and evaluation at OpenAI. Collaborates with researchers to build reliable, high-performance systems handling massive data volumes in a fast-paced environment.

230k – 385k
HybridData Engineering
OpenAI

Data Engineer, Analytics

OpenAISan Francisco, CA

Build and manage data pipelines and canonical datasets for product metrics, safety systems, and business decisions. Collaborate with cross-functional teams including Data Science and Research; requires 3+ years data engineering experience with Spark, ETL tools, and distributed systems.

230k – 385k
On-site3+ YOEData Engineering
Anyscale

Software Engineer (Ray Data)

AnyscaleSan Francisco, CA

Build, optimize, and scale Ray Data, a Python-native data processing engine for AI/ML workloads. Improve performance, ensure fault tolerance at high scale, and support production training and multi-modal batch inference for AI-native companies.

226k – 241k
On-site4+ YOEData Engineering