# Software Engineer, Inference - Multi Modal

**Company:** [OpenAI](https://hotfix.jobs/companies/openai)
**Location:** San Francisco, CA
**Role:** ML Engineering
**Salary:** $295k – $555k/yr
**Skills:** Inference Systems, LLMs, Multimodal Models, Gpu Workloads, vLLM, Tensorrt-Llm, Tensor Parallelism, Distributed Compute, Networking, High-Throughput Data Handling
**Posted:** 2025-05-21

> Build and optimize high-performance inference infrastructure for OpenAI's multimodal models handling image, audio, and other non-text inputs at scale. Collaborate with research and product teams on low-latency production systems using GPU workloads and inference tooling.

## Job Description

## Responsibilities
- Design and implement inference infrastructure for large-scale multimodal models.
- Optimize systems for high-throughput, low-latency delivery of image and audio inputs and outputs.
- Enable experimental research workflows to transition into reliable production services.
- Collaborate closely with researchers, infra teams, and product engineers to deploy state-of-the-art capabilities.
- Contribute to system-level improvements including GPU utilization, tensor parallelism, and hardware abstraction layers.

## Requirements
- Experience building and scaling inference systems for LLMs or multimodal models.
- Worked with GPU-based ML workloads and understand the performance dynamics of large models, especially with complex data like images or audio.
- Enjoy experimental, fast-evolving work and collaborating closely with research.
- Comfortable dealing with systems that span networking, distributed compute, and high-throughput data handling.
- Familiarity with inference tooling like vLLM, TensorRT-LLM, or custom model parallel systems.
- Own problems end-to-end and excited to operate in ambiguous, fast-moving spaces.

## Nice to Have
- Experience working with image generation or audio synthesis models in production.
- Exposure to distributed ML training or system-efficient model design.

## Similar roles

- [Agent Post-Training, API & Power Users](https://hotfix.jobs/jobs/fe6ae516-bafa-4cc6-af78-f20aa90a9eb3) - OpenAI - San Francisco, CA - $295k – $445k/yr
- [Software Engineer, RL Training Infra](https://hotfix.jobs/jobs/5c9ca321-9012-4a35-9c66-fbd05cddb52e) - OpenAI - San Francisco, CA - $295k – $445k/yr
- [Software Engineer, ML Systems & Training Architecture](https://hotfix.jobs/jobs/09ff26d4-974c-471b-9d70-82c93f3c6aab) - OpenAI - San Francisco, CA - $295k – $380k/yr
- [Software Engineer, Inference - Performance Optimization](https://hotfix.jobs/jobs/0f2ff1a5-79fe-4fe9-ad20-d84aec238f5e) - OpenAI - San Francisco, CA - $295k – $555k/yr
- [Machine Learning Engineer, Distributed Data Systems](https://hotfix.jobs/jobs/deb54433-eb08-4c3e-adee-afee842e3253) - OpenAI - San Francisco, CA - $295k – $445k/yr

**Apply:** https://hotfix.jobs/jobs/9e289218-25c8-49a0-a372-173aaa8d5785
**Canonical:** https://hotfix.jobs/jobs/9e289218-25c8-49a0-a372-173aaa8d5785