Skip to content
OpenAIOpenAISan Francisco, CA

Software Engineer, Data Infrastructure

Builds and operates scalable data infrastructure including compute fleets, storage systems, and streaming platforms to support OpenAI's AI products, research, and analytics. Requires 4+ years in data or infrastructure engineering with expertise in Spark, Kafka, and distributed systems.

185k – 385k/yr
Hybrid4+ YOEData Engineering

About the role

Responsibilities

  • Design, build, and maintain data infrastructure systems such as distributed compute, data orchestration, distributed storage, streaming infrastructure, machine learning infrastructure while ensuring scalability, reliability, and security.
  • Ensure our data platform can scale by orders of magnitude while remaining reliable and efficient.
  • Accelerate company productivity by empowering your fellow engineers & teammates with excellent data tooling and systems.
  • Collaborate with product, research and analytics teams to build the technical foundations capabilities that unlock new features and experiences.
  • Own the reliability of the systems you build, including participation in an on-call rotation for critical incidents.

Requirements

  • 4+ years in data infrastructure engineering OR 4+ years in infrastructure engineering with a strong interest in data.
  • Experience supporting Spark, Kafka, Flink, Airflow, Trino, or Iceberg as platforms.
  • Well-versed in infrastructure tooling like Terraform.
  • Experienced in debugging large-scale distributed systems.

Nice-to-Haves

  • Comfortable with ambiguity and rapid change.
  • Intrinsic desire to learn and fill in missing skills, and talent for sharing learnings clearly.

Skills

SparkKafkaFlinkAirflowTrinoIcebergTerraformDelta LakeKubernetesChronon

Similar roles

Data Engineering jobs
Abridge

Data Engineer

AbridgeSan Francisco, CA

Builds and optimizes scalable data pipelines, storage, and OLAP databases for ML training, analytics, and product features. Requires 5+ years in data engineering, proficiency in Python/SQL/cloud platforms, and distributed systems experience.

185k – 217k/yr
Hybrid5+ YOEData Engineering
Scale AI

Software Engineer, Data Infrastructure

Scale AINew York, NY +1

Architect and build foundational data infrastructure for massive simulation outputs. Design novel data models and high-throughput pipelines to feed LLMs with structured context from complex, state-based environments.

186k – 233k/yr
On-site5+ YOEData Engineering
Actively AI

Data Engineer

Actively AINew York, NY

Own data and analytics end-to-end: architect internal systems, build metrics/dashboards, and translate customer and product signals into structured inputs for AI agents.

180k – 210k/yr
On-siteData Engineering
Baseten

Data Engineer

BasetenSan Francisco, CA +1

Builds and scales internal data platform by designing data models, pipelines, and analytics infrastructure to transform raw product/business data into reliable datasets for company-wide decision-making. Partners with stakeholders across Product, Engineering, Finance, Marketing, and Sales.

180k – 250k/yr
HybridData Engineering
xAI

Software Engineer - Data Platform

xAIPalo Alto, CA +1

Builds and operates petabyte-scale data platform infrastructure using Kafka, Spark, Flink, and Trino to power real-time ML pipelines and analytics. Requires expertise in distributed systems, stream processing, and systems languages like Rust, Go, or Scala.

180k – 440k/yr
HybridData Engineering