Designs and implements dataset infrastructure for OpenAI's large-scale LLM training stack, including standardized APIs for multimodal data, scaling pipelines across GPU fleets, and performance debugging. Requires strong distributed systems experience and collaboration with researchers.
250k – 380k
On-siteData Engineering
About the role
Responsibilities
Design and maintain standardized dataset APIs, including for multimodal (MM) data that cannot fit in memory.
Build proactive testing and scale validation pipelines for dataset loading at GPU scale.
Collaborate with teammates to integrate datasets seamlessly into training and inference pipelines, ensuring smooth adoption and a great user experience.
Document and maintain dataset interfaces so they are discoverable, consistent, and easy for other teams to adopt.
Establish safeguards and validation systems to ensure datasets remain reproducible and unchanged once standardized.
Debug and resolve performance bottlenecks in distributed dataset loading (e.g., straggler systems slowing global training).
Provide visualization and inspection tools to surface errors, bugs, or bottlenecks in datasets.
Requirements
Strong engineering fundamentals with experience in distributed systems, data pipelines, or infrastructure.
Experience building APIs, modular code, and scalable abstractions, while recognizing that abstractions ultimately serve the users and UX is an important part of the abstractions design.
Comfortable debugging bottlenecks across large fleets of machines.
Take pride in building infrastructure that “just works,” and find joy in being the guardian of reliability and scale.
Collaborative, humble, and excited to own a foundational (if not glamorous) part of the ML stack.
Nice-to-Haves
Background knowledge in data math, probability, or distributed data theory.
Worked with GPU-scale distributed systems or dataset scaling for real-time data.
Software Engineer building scalable data infrastructure, cataloging, versioning, and lineage tools to support ML research and production workflows at an AI-driven hedge fund. Requires 3+ years experience, strong software design skills, and expertise in a modern language like Python or Java.
235k – 300k
Remote3+ YOEData Engineering
Data Operations Manager, Human Data
AnthropicSan Francisco, CA +1
Data Operations Manager responsible for building and scaling data strategies, vendor partnerships, and high-quality data pipelines to advance frontier AI research in RLHF, safety, tool use, and agentic systems at Anthropic. Requires 3+ years operations/PM experience, strong project management, data analysis skills, and passion for AI safety.
270k – 365k
Hybrid3+ YOEData Engineering
Software Engineer, Distributed Data Systems (Sora)
OpenAISan Francisco, CA
Designs and scales distributed data infrastructure for large-scale multimodal training and evaluation at OpenAI. Collaborates with researchers to build reliable, high-performance systems handling massive data volumes in a fast-paced environment.
230k – 385k
HybridData Engineering
Data Engineer, Analytics
OpenAISan Francisco, CA
Build and manage data pipelines and canonical datasets for product metrics, safety systems, and business decisions. Collaborate with cross-functional teams including Data Science and Research; requires 3+ years data engineering experience with Spark, ETL tools, and distributed systems.
230k – 385k
On-site3+ YOEData Engineering
Software Engineer (Ray Data)
AnyscaleSan Francisco, CA
Build, optimize, and scale Ray Data, a Python-native data processing engine for AI/ML workloads. Improve performance, ensure fault tolerance at high scale, and support production training and multi-modal batch inference for AI-native companies.