Skip to content
ModalModalNew York, NY

Member of Technical Staff - ML Training Systems

Build and optimize ML training systems for production-scale language models using PyTorch and frameworks like Hugging Face. Requires 5+ years experience in high-performance code and training optimizations; onsite in NYC or SF.

150k – 350k/yr
On-site5+ YOEML Engineering

About the role

Requirements

  • 5+ years of experience writing high-quality, high-performance code.
  • Experience working with torch and high-level training frameworks (Huggingface, verl, slime)
  • Experience with ML training optimization (tell us a story about eliminating data loading bottlenecks, overlapping communications with compute, rewriting a trainer to handle off-policy rollouts, etc.)
  • Nice-to-have: familiarity with low-level operating system foundations (Linux kernel, file systems, containers, etc.)
  • Ability to work in-person, in our NYC or San Francisco office.

Skills

PyTorchHugging FaceMl Training OptimizationLinux KernelFile SystemsContainers

Similar roles

ML Engineering jobs
Sieve

Member of Technical Staff, Machine Learning

SieveSan Francisco, CA

Machine Learning Engineer owning the full ML lifecycle for multimodal video datasets at Sieve. Fine-tune VLMs, build evaluation/QA pipelines with frontier models, design filtering systems over internet-scale data, and ship production improvements for top AI labs. Requires strong Python, PyTorch, and production ML experience.

150k – 350k/yr
On-site5+ YOEML Engineering
Modal

Member of Technical Staff

ModalNew York, NY +1

Member of Technical Staff conducting hands-on LLM inference research at Modal. Own end-to-end bets on techniques like speculative decoding, quantization, KV-cache management, and disaggregation to improve cost per token and tail latency on production workloads. Requires strong LLM serving stack expertise and a track record shipping research or systems.

150k – 350k/yr
On-siteML Engineering
Parallel

Member of Technical Staff, Model Training

ParallelCalifornia

Own the training pipeline for search and agent models, building from product usage data through fine-tuning and evaluation to production deployment. Requires deep expertise in transformer fine-tuning, data curation, and training models for ranking, retrieval, and agent behavior.

150k – 300k/yr
On-siteML Engineering
Parallel

Member of Technical Staff, Search Ranking

ParallelUnited States

Own the multi-stage ranking pipeline for web-scale search, balancing precision, recall, latency, and compute cost across retrieval, first-pass ranking, and neural reranking.

150k – 300k/yr
On-site7+ YOEML Engineering
Second Nature

Staff Software Engineer, Engineering AI Team

Second NatureUnited States

Staff engineer builds AI-driven platform infrastructure for SDLC transformation, owns end-to-end experiments using AI agents like Claude, and ensures high-velocity code delivery with strong abstractions and real-world grounding. Requires staff-level architecture experience and AI-native workflows.

150k – 180k/yr
RemoteML Engineering