Skip to content
PulsePulseSan Francisco, CA

Software Engineer, Inference

Develops low-latency, high-throughput inference services for OCR and multimodal models, optimizing batching, kernels, and autoscaling while evaluating serving frameworks. Requires 3+ years in performance engineering or ML systems with strong Python and GPU experience.

150k – 230k/yr
On-site3+ YOEML Engineering

About the role

Responsibilities

  • Build inference services with smart batching and caching
  • Optimize kernels, tokenization, and model graphs
  • Evaluate vLLM, TensorRT LLM, and Triton tradeoffs
  • Implement autoscaling and admission control with clear SLOs
  • Own performance dashboards and capacity planning

Requirements

  • 3+ years in performance engineering or ML systems
  • Strong Python, plus C++ or CUDA exposure
  • Experience with GPU profiling and model serving

Nice to Have

  • Experience reducing p95 and cost in production ML systems
  • Prior startup or founding experience

Compensation and Benefits

  • Competitive base salary plus equity
  • Performance-based bonus
  • Relocation assistance for Bay Area moves
  • Daily meal stipend
  • Medical, vision, and dental coverage

Skills

PythonC++CUDAvLLMTensorrt LlmTritonGpu ProfilingModel ServingAutoscalingSLOs

Similar roles

ML Engineering jobs
Applied Intuition

Perception & Fusion Engineer

Applied IntuitionArlington, VA

Develop and integrate real-time sensor perception and fusion algorithms for autonomous vehicles across land, air, sea, and space domains. Requires MS/PhD or 5+ years experience with multi-modal sensors (EO/IR/radar), ML deployment, and DoD clearance eligibility.

150k – 220k/yr
On-site5+ YOEML Engineering
Deepgram

Applied ML Engineer

DeepgramCalifornia

Own the research-to-production pipeline at Deepgram, turning experimental speech ML models into reliable, scalable production services. Partner with researchers on robust workflows, automated release gates, inference optimization, and feedback loops across hybrid GPU infrastructure.

150k – 220k/yr
Remote5+ YOEML Engineering
Deepgram

Backend Engineer

DeepgramCalifornia

Backend Engineer building and optimizing Deepgram's core inference services for speech processing, including networking, audio transcoding, latency/memory optimization, and distributed compute orchestration. Requires 3+ years experience with Rust (or C/C++) and Python.

150k – 220k/yr
Remote3+ YOEML Engineering
Distyl AI

Research Engineer, Post-Training

Distyl AISan Francisco, CA +1

Research Engineers at Distyl build and productionize post-training techniques (fine-tuning, RLHF, reward models, evals) to improve reliability and behavior of compound AI systems for enterprise customers. Requires strong applied ML experimentation skills and ownership of real-world outcomes.

150k – 250k/yr
HybridML Engineering
Distyl AI

Research Engineer, Agents

Distyl AISan Francisco, CA +1

Research Engineers at Distyl build and productionize reliable agentic AI systems and compound architectures for enterprise workflows. They design agents, develop evaluation frameworks, run experiments on reasoning and failure modes, and integrate into customer environments.

150k – 250k/yr
HybridML Engineering