# Director/Sr. Manager, AI Inference Model Scaling

**Company:** [Cerebras Systems](https://hotfix.jobs/companies/cerebras-systems)
**Location:** Sunnyvale, CA, Toronto, Canada
**Role:** Engineering Management
**Experience:** 12+ years
**Skills:** C++, Python, llvm, mlir, xla, tvm, torch fx, PyTorch, JAX, TensorFlow, onnx, graph compilation, Distributed Systems, llm inference
**Posted:** 2026-07-23

> Leads a globally distributed engineering organization enabling foundation models and generative AI workloads on Cerebras hardware. The role requires deep compiler or ML infrastructure expertise, substantial engineering leadership experience, and cross-functional collaboration across hardware, runtime, cloud, and research teams.

## Job Description

## Responsibilities

### Technical Leadership
- Define the technical roadmap and strategy for the team.
- Establish technical direction across multiple teams and engineering leaders.
- Lead design reviews and establish engineering standards.
- Drive support for emerging LLM architectures and inference workloads.

### Team Leadership
- Hire, mentor, and grow a high-performing engineering team.
- Develop future technical leaders and managers.
- Drive organizational planning, headcount strategy, and investment priorities.
- Foster a strong engineering culture focused on execution, quality, and innovation.
- Scale engineering processes while maintaining execution velocity.

### Cross-Functional Collaboration
- Partner with Cloud Platform, ML, and Hardware teams in planning and delivering end-to-end service enablement in Cloud and On-Premise settings.
- Work with Product Management to prioritize model enablement and customer needs.
- Collaborate closely with customers and solution architects on new model bring-up.
- Influence future hardware/software co-design through ML model enablement and optimization insights.

### Delivery and Execution
- Own planning, prioritization, and execution across multiple concurrent initiatives.
- Balance rapid model support with long-term ML Compiler architecture.
- Drive predictable delivery for strategic customer commitments.

## Required Qualifications

- BS, MS, or PhD in Computer Science, Computer Engineering, or a related field.
- 12+ years building compiler, ML systems, or infrastructure software.
- 5+ years leading engineering teams.
- Deep experience with modern compiler infrastructure, such as LLVM, MLIR, XLA, TVM, or Torch FX.
- Strong understanding of graph compilation and optimization.
- Experience with Python and C++.
- Experience delivering production-quality software.
- Strong communication and cross-functional leadership skills.

## Preferred Qualifications

- Experience building compiler frontends for AI accelerators.
- Experience supporting PyTorch, JAX, TensorFlow, or ONNX.
- Experience with LLM inference or training systems.
- Familiarity with distributed compilation.
- Experience working with hardware architects.
- Experience leading teams through rapid growth.

## Benefits and Culture

- Build a breakthrough AI platform beyond the constraints of GPUs.
- Publish and open source cutting-edge AI research.
- Work on one of the fastest AI supercomputers in the world.
- Enjoy job stability with startup vitality.
- Work in a simple, non-corporate culture that respects individual beliefs.

## Similar roles

- [Senior Manager / Director of Engineering, Consumer](https://hotfix.jobs/jobs/5836a3b9-a003-4491-a601-10e4e24c9f4c) - Nourish - New York, NY
- [Director of Engineering, AI Enterprise](https://hotfix.jobs/jobs/ca6ad145-43ed-49e4-80d7-be1b6184688d) - Snowflake - Menlo Park, CA - $264k – $380k/yr
- [Head of Engineering](https://hotfix.jobs/jobs/0eaa07ae-d596-4c35-933f-47b09f9f1a51) - LeafLink - Remote - $240k – $270k/yr
- [Director, Developer Platform & Experience](https://hotfix.jobs/jobs/f55ea75c-4bd7-4677-9c45-f24c06218f53) - Motive - San Francisco, CA - $229k – $285k/yr
- [Director of Engineering](https://hotfix.jobs/jobs/a0fe9e3e-4c13-40b9-91f6-ce54cbc7de9d) - OPSWAT - Remote

**Apply:** https://hotfix.jobs/jobs/c9c3d4a9-c108-4062-9931-abd9ac3e3f1f
**Canonical:** https://hotfix.jobs/jobs/c9c3d4a9-c108-4062-9931-abd9ac3e3f1f