# Member of Technical Staff - ML Performance

**Company:** [Modal](https://hotfix.jobs/companies/modal)
**Location:** New York, NY, San Francisco, CA
**Role:** ML Engineering
**Salary:** $150k – $350k/yr
**Experience:** 5+ years
**Skills:** PyTorch, vLLM, TensorRT, CUDA, Nvidia Gpu, Ml Frameworks, Linux Kernel, Containers
**Posted:** 2024-12-18

> Engineers optimize ML systems for performance at scale, focusing on GPU utilization, inference engines, and container runtime to boost throughput and reduce latency for language and diffusion models. Requires 5+ years experience with PyTorch, CUDA, and performance debugging.

## Job Description

## Requirements
- 5+ years of experience writing high-quality, high-performance code.
- Experience working with torch, high-level ML frameworks, and inference engines (vLLM or TensorRT).
- Familiarity with Nvidia GPU architecture and CUDA.
- Experience with ML performance engineering (tell us a story about boosting GPU performance — debugging SM occupancy issues, rewriting an algorithm to be compute-bound, eliminating host overhead, etc).

## Nice-to-have
- Familiarity with low-level operating system foundations (Linux kernel, file systems, containers, etc).

## Similar roles

- [Member of Technical Staff, Machine Learning](https://hotfix.jobs/jobs/0690a304-2c3d-4cff-aa6b-d101ed35ca25) - Sieve - San Francisco, CA - $150k – $350k/yr
- [Member of Technical Staff](https://hotfix.jobs/jobs/0be719d4-4a8a-484f-ad6e-6b8b60347618) - Modal - New York, NY - $150k – $350k/yr
- [Member of Technical Staff, Model Training](https://hotfix.jobs/jobs/2970f6fe-48c0-4ad2-bb34-51d7b2b4b4f4) - Parallel - California - $150k – $300k/yr
- [Member of Technical Staff, Search Ranking](https://hotfix.jobs/jobs/42567fd9-0b81-4e32-978b-09f4bf114749) - Parallel - $150k – $300k/yr
- [Staff Software Engineer, Engineering AI Team](https://hotfix.jobs/jobs/518f3095-1264-413d-8cc7-7dca7b4bac0c) - Second Nature - Remote - $150k – $180k/yr

**Apply:** https://hotfix.jobs/jobs/41e91085-399c-495f-ae55-52c1de8a3c1a
**Canonical:** https://hotfix.jobs/jobs/41e91085-399c-495f-ae55-52c1de8a3c1a