# Software Engineer, Data Infrastructure

**Company:** [OpenAI](https://hotfix.jobs/companies/openai)
**Location:** San Francisco, CA
**Role:** Data Engineering
**Salary:** $185k – $385k/yr
**Experience:** 4+ years
**Skills:** Spark, Kafka, Flink, Airflow, Trino, Iceberg, Terraform, Delta Lake, Kubernetes, Chronon
**Posted:** 2024-06-27

> Builds and operates scalable data infrastructure including compute fleets, storage systems, and streaming platforms to support OpenAI's AI products, research, and analytics. Requires 4+ years in data or infrastructure engineering with expertise in Spark, Kafka, and distributed systems.

## Job Description

## Responsibilities
- Design, build, and maintain data infrastructure systems such as distributed compute, data orchestration, distributed storage, streaming infrastructure, machine learning infrastructure while ensuring scalability, reliability, and security.
- Ensure our data platform can scale by orders of magnitude while remaining reliable and efficient.
- Accelerate company productivity by empowering your fellow engineers & teammates with excellent data tooling and systems.
- Collaborate with product, research and analytics teams to build the technical foundations capabilities that unlock new features and experiences.
- Own the reliability of the systems you build, including participation in an on-call rotation for critical incidents.

## Requirements
- 4+ years in data infrastructure engineering OR 4+ years in infrastructure engineering with a strong interest in data.
- Experience supporting Spark, Kafka, Flink, Airflow, Trino, or Iceberg as platforms.
- Well-versed in infrastructure tooling like **Terraform**.
- Experienced in debugging large-scale distributed systems.

## Nice-to-Haves
- Comfortable with ambiguity and rapid change.
- Intrinsic desire to learn and fill in missing skills, and talent for sharing learnings clearly.

## Similar roles

- [Data Engineer](https://hotfix.jobs/jobs/d6a431cf-a0be-4dd5-86c2-34768adbf129) - Abridge - San Francisco, CA - $185k – $217k/yr
- [Software Engineer, Data Infrastructure](https://hotfix.jobs/jobs/753367fe-43ca-4551-898b-77247ddd27d8) - Scale AI - New York, NY - $186k – $233k/yr
- [Data Engineer](https://hotfix.jobs/jobs/6b412eb4-37c6-4c36-8f77-10e86bc79c93) - Actively AI - New York, NY - $180k – $210k/yr
- [Data Engineer](https://hotfix.jobs/jobs/7443d425-2ed8-49a3-9b59-ee77171cd7d0) - Baseten - San Francisco, CA - $180k – $250k/yr
- [Software Engineer - Data Platform](https://hotfix.jobs/jobs/f6588639-59ab-484a-9fab-418122ada203) - xAI - Palo Alto, CA - $180k – $440k/yr

**Apply:** https://hotfix.jobs/jobs/30aec125-6512-4b6a-b25c-2345791db60c
**Canonical:** https://hotfix.jobs/jobs/30aec125-6512-4b6a-b25c-2345791db60c