Skip to content
OpenAIOpenAISan Francisco, CA

Inference Technical Lead, Sora

Leads GPU inference engineering for Sora, optimizing model serving efficiency, kernel-level performance, and scalability. Collaborates with research and product teams to build reliable infrastructure for multimodal AI models.

380k – 380k
HybridML Engineering

About the role

Responsibilities

  • Perform engineering efforts focused on improving model serving, inference performance, and system efficiency
  • Drive optimizations from a kernel and data movement perspective to improve system throughput and reliability
  • Partner closely with research and product teams to ensure our models perform effectively at scale
  • Design, build, and improve critical serving infrastructure to support Sora’s growth and reliability needs

Requirements

  • Deep expertise in model performance optimization, particularly at the inference layer
  • Strong background in kernel-level systems, data movement, and low-level performance tuning
  • Excited about scaling high-performing AI systems that serve real-world, multimodal workloads
  • Can navigate ambiguity, set technical direction, and drive complex initiatives to completion

Skills

Gpu InferenceModel ServingKernel OptimizationPerformance TuningData MovementInference OptimizationAi SystemsMultimodal WorkloadsCUDAPyTorch

Similar roles

ML Engineering jobs
Anthropic

Software Engineer, Research Infrastructure

AnthropicSan Francisco, CA +1

Build and scale research infrastructure and distributed systems at Anthropic to accelerate ML research workflows. Independently lead complex multi-month projects, drive cross-org alignment, and partner with researchers in a fast-evolving, ambiguous environment.

405k – 625k
Hybrid7+ YOEML Engineering
Anthropic

Research Engineer, Life Sciences

AnthropicSan Francisco, CA

Research Engineer developing novel evaluation frameworks and training strategies for AI systems in life sciences and biology. Requires experience training/evaluating LLMs, Python/ML proficiency, and data pipeline expertise; biology background preferred but not required.

350k – 500k
Hybrid8+ YOEML Engineering
Anthropic

Research Engineer / Research Scientist, Vision

AnthropicNew York, NY +2

Research engineer/scientist building and evaluating vision capabilities for Claude models. Requires 7+ years ML/computer vision experience and work across pretraining, RL, and agentic infrastructure.

350k – 850k
Hybrid7+ YOEML Engineering
Anthropic

ML Infrastructure Engineer, Safeguards

AnthropicSan Francisco, CA

Build and operate production ML infrastructure powering Claude's safety systems, including critical backend services on the token generation path, SLOs, observability, incident response, and platform-agnostic deployment tooling across 1P and 3P clouds. Requires deep distributed systems and on-call experience at scale; ML/transformer familiarity not required.

320k – 485k
Hybrid8+ YOEML Engineering
Anthropic

Software Engineer, Safeguards Evals

AnthropicSan Francisco, CA +1

Build evaluation infrastructure and datasets to measure how well AI agents detect misuse and policy violations. Design experiments, productionize evals into release pipelines, and improve safety investigation capabilities.

320k – 485k
Hybrid6+ YOEML Engineering