# Software Engineer, Inference

**Company:** [Pulse](https://hotfix.jobs/companies/pulse)
**Location:** San Francisco, CA
**Role:** ML Engineering
**Salary:** $150k – $230k/yr
**Experience:** 3+ years
**Skills:** Python, C++, CUDA, vLLM, Tensorrt Llm, Triton, Gpu Profiling, Model Serving, Autoscaling, SLOs
**Posted:** 2025-07-30

> Develops low-latency, high-throughput inference services for OCR and multimodal models, optimizing batching, kernels, and autoscaling while evaluating serving frameworks. Requires 3+ years in performance engineering or ML systems with strong Python and GPU experience.

## Job Description

## Responsibilities
- Build inference services with smart batching and caching
- Optimize kernels, tokenization, and model graphs
- Evaluate vLLM, TensorRT LLM, and Triton tradeoffs
- Implement autoscaling and admission control with clear SLOs
- Own performance dashboards and capacity planning

## Requirements
- 3+ years in performance engineering or ML systems
- Strong Python, plus C++ or CUDA exposure
- Experience with GPU profiling and model serving

## Nice to Have
- Experience reducing p95 and cost in production ML systems
- Prior startup or founding experience

## Compensation and Benefits
- Competitive base salary plus equity
- Performance-based bonus
- Relocation assistance for Bay Area moves
- Daily meal stipend
- Medical, vision, and dental coverage

## Similar roles

- [Perception & Fusion Engineer](https://hotfix.jobs/jobs/8655c0c2-c78a-420d-b397-b01bb4bef878) - Applied Intuition - Arlington, VA - $150k – $220k/yr
- [Applied ML Engineer](https://hotfix.jobs/jobs/3016b55f-07d3-486b-ba7c-0c68f9819cd0) - Deepgram - Remote - $150k – $220k/yr
- [Backend Engineer](https://hotfix.jobs/jobs/ab7e0e7b-91ae-4435-ae9f-df959e7843f1) - Deepgram - Remote - $150k – $220k/yr
- [Research Engineer, Post-Training](https://hotfix.jobs/jobs/09d480a0-f2fe-4418-8549-14c5c9fa2aa0) - Distyl AI - San Francisco, CA - $150k – $250k/yr
- [Research Engineer, Agents](https://hotfix.jobs/jobs/bb345787-77ae-40a4-8b65-895e6a979c5e) - Distyl AI - San Francisco, CA - $150k – $250k/yr

**Apply:** https://hotfix.jobs/jobs/d7482613-a7b7-4bcd-becb-8923169115d2
**Canonical:** https://hotfix.jobs/jobs/d7482613-a7b7-4bcd-becb-8923169115d2