# Inference Technical Lead, Sora

**Company:** [OpenAI](https://hotfix.jobs/companies/openai)
**Location:** San Francisco, CA
**Role:** ML Engineering
**Salary:** $380k – $380k/yr
**Skills:** Gpu Inference, Model Serving, Kernel Optimization, Performance Tuning, Data Movement, Inference Optimization, Ai Systems, Multimodal Workloads, CUDA, PyTorch
**Posted:** 2025-04-21

> Leads GPU inference engineering for Sora, optimizing model serving efficiency, kernel-level performance, and scalability. Collaborates with research and product teams to build reliable infrastructure for multimodal AI models.

## Job Description

## Responsibilities
- Perform engineering efforts focused on improving model serving, inference performance, and system efficiency
- Drive optimizations from a kernel and data movement perspective to improve system throughput and reliability
- Partner closely with research and product teams to ensure our models perform effectively at scale
- Design, build, and improve critical serving infrastructure to support Sora’s growth and reliability needs

## Requirements
- Deep expertise in model performance optimization, particularly at the inference layer
- Strong background in kernel-level systems, data movement, and low-level performance tuning
- Excited about scaling high-performing AI systems that serve real-world, multimodal workloads
- Can navigate ambiguity, set technical direction, and drive complex initiatives to completion

## Similar roles

- [Software Engineer, Research Infrastructure](https://hotfix.jobs/jobs/aba979c0-7492-4fbb-bbee-841c3aa67496) - Anthropic - San Francisco, CA - $405k – $625k/yr
- [Research Engineer, Life Sciences](https://hotfix.jobs/jobs/3da68010-679e-43e2-b57f-64fadcdb6a2f) - Anthropic - San Francisco, CA - $350k – $500k/yr
- [Research Engineer / Research Scientist, Vision](https://hotfix.jobs/jobs/a82a404a-d973-4b1c-9a7e-73ce557c167a) - Anthropic - New York, NY - $350k – $850k/yr
- [ML Infrastructure Engineer, Safeguards](https://hotfix.jobs/jobs/a201ecac-bb92-40b0-8991-819fab103aa9) - Anthropic - San Francisco, CA - $320k – $485k/yr
- [Software Engineer, Safeguards Evals](https://hotfix.jobs/jobs/f3a9ddc2-d800-4f91-939b-20343a45a632) - Anthropic - San Francisco, CA - $320k – $485k/yr

**Apply:** https://hotfix.jobs/jobs/47f5466e-e1d5-4015-a345-795ca5001ef9
**Canonical:** https://hotfix.jobs/jobs/47f5466e-e1d5-4015-a345-795ca5001ef9