# AI Inference Engineer

**Company:** [Quadric](https://hotfix.jobs/companies/quadric)
**Location:** Burlingame, CA
**Role:** ML Engineering
**Experience:** 5+ years
**Skills:** Model Quantization, Ptq, Qat, Onnx Runtime, PyTorch, vLLM, Hugging Face Transformers, Neural Compressor, Llama.Cpp, C++, Python, Model Profiling, Benchmarking, Ai Inference, Llm Deployment
**Posted:** 2025-11-24

> AI Inference Engineer ports, optimizes, and benchmarks AI/LLM models on Quadric's GPNPU platform for edge devices. Requires 5+ years in model inference frameworks, quantization expertise, and proficiency in C++/Python.

## Job Description

## Responsibilities
- Quantize, prune and convert models for deployment
- Port models to Quadric platform using Quadric toolchain
- Optimize inference deployment for latency, speed
- Benchmark and profile model performance and accuracy
- Collaborate across related areas of the AI inference stack to support team and business priorities
- Develop tools to scale and speed up the deployment
- Make improvements to SDK and runtime
- Provide technical support and documents to customers and developer community

## Requirements
- Bachelor’s or Master’s in Computer Science and/or Electrical Engineering
- 5+ years of experience in AI/LLM model inference and deployment frameworks/tools
- Experience with model quantization (PTQ, QAT) and tools
- Experience with model accuracy measures
- Experience with model inference performance profiling
- Experience with at least one of the following frameworks: onnxruntime, Pytorch, vLLM, huggingface-transformer, neural-compressor, llamacpp
- Proficiency in C/C++ and Python
- Demonstrate good capability in problem solving, debug and communication

## Similar roles

- [CoDesign & NextGen Performance Engineer](https://hotfix.jobs/jobs/2cb728b7-a9ea-44b0-b16a-47364021f7be) - Cerebras Systems - Sunnyvale, CA
- [Research Engineer, Privacy](https://hotfix.jobs/jobs/3220c5d0-0e5f-4869-b133-1ed126b4208a) - OpenAI - San Francisco, CA - $380k – $445k/yr
- [Research Engineer](https://hotfix.jobs/jobs/b4d18018-e64d-4828-a8b4-303225328e17) - Console - San Francisco, CA - $200k – $350k/yr
- [Software Engineer, AI Platform](https://hotfix.jobs/jobs/7ddad000-3e1c-47cb-a45b-31d8e72abc4f) - Notion - San Francisco, CA - $180k – $201k/yr
- [Machine Learning Engineer](https://hotfix.jobs/jobs/97713038-58cb-46c5-a9c7-0e1554e1ba4f) - Liftoff - Remote - $215k – $275k/yr

**Apply:** https://hotfix.jobs/jobs/91057e98-3997-478e-94cc-f57eda1d57a2
**Canonical:** https://hotfix.jobs/jobs/91057e98-3997-478e-94cc-f57eda1d57a2