# Software Engineer, Collective Communication

**Company:** [OpenAI](https://hotfix.jobs/companies/openai)
**Location:** San Francisco, CA
**Role:** Backend Engineering
**Salary:** $380k – $555k/yr
**Skills:** C++, CUDA, Rdma, Distributed Algorithms, Network Simulation, Collective Communication, Gpu Programming, Network Transports
**Posted:** 2024-04-20

> Designs and implements custom networking collectives using C++ and CUDA for efficient AI model training on supercomputers. Requires expertise in low-level performance-critical software, RDMA distributed algorithms, and GPU/CPU code.

## Job Description

## Responsibilities
- Collaborate closely with ML researchers to design and implement efficient collective operations in C++ and CUDA.
- Ensure that our largest training jobs take full advantage of the different network transports used in our supercomputers.
- Work on simulations to inform our future supercomputer network designs.

## Requirements
- Background in low level performance critical software.
- Have written distributed algorithms using RDMA in the past.
- Comfortable writing low level performance sensitive CPU and/or GPU code.
- Familiar with network simulation techniques.

## Nice-to-haves
- Experience with collective communication.

## Similar roles

- [Software Engineer, Foundations Retrieval](https://hotfix.jobs/jobs/f3e59539-3c2d-4ce4-9301-d1bd039fe355) - OpenAI - San Francisco, CA - $380k – $555k/yr
- [Software Engineer, ChatGPT Infrastructure](https://hotfix.jobs/jobs/19bcecf2-7550-46d5-9c79-60e56131132d) - OpenAI - San Francisco, CA - $255k – $405k/yr
- [Backend Software Engineer](https://hotfix.jobs/jobs/d634298b-0133-42e1-bced-f4c101307853) - Recall - San Francisco, CA - $235k – $235k/yr
- [Software Engineer, Codex -Enterprise Controls](https://hotfix.jobs/jobs/9fc148ac-afcb-4558-a41e-a772e8869a71) - OpenAI - San Francisco, CA - $230k – $385k/yr
- [Software Engineer, Private Computing](https://hotfix.jobs/jobs/61850697-3157-406e-8968-ea0a1b8753cd) - OpenAI - San Francisco, CA - $230k – $385k/yr

**Apply:** https://hotfix.jobs/jobs/d29bcc0b-6907-49c2-a58b-09b2b3b52a6b
**Canonical:** https://hotfix.jobs/jobs/d29bcc0b-6907-49c2-a58b-09b2b3b52a6b