Build and optimize ML training systems for production-scale language models using PyTorch and frameworks like Hugging Face. Requires 5+ years experience in high-performance code and training optimizations; onsite in NYC or SF.
150k – 350k/yr
On-site5+ YOEML Engineering
About the role
Requirements
5+ years of experience writing high-quality, high-performance code.
Experience working with torch and high-level training frameworks (Huggingface, verl, slime)
Experience with ML training optimization (tell us a story about eliminating data loading bottlenecks, overlapping communications with compute, rewriting a trainer to handle off-policy rollouts, etc.)
Nice-to-have: familiarity with low-level operating system foundations (Linux kernel, file systems, containers, etc.)
Ability to work in-person, in our NYC or San Francisco office.
Skills
PyTorchHugging FaceMl Training OptimizationLinux KernelFile SystemsContainers
Machine Learning Engineer owning the full ML lifecycle for multimodal video datasets at Sieve. Fine-tune VLMs, build evaluation/QA pipelines with frontier models, design filtering systems over internet-scale data, and ship production improvements for top AI labs. Requires strong Python, PyTorch, and production ML experience.
150k – 350k/yr
On-site5+ YOEML Engineering
Member of Technical Staff
ModalNew York, NY +1
Member of Technical Staff conducting hands-on LLM inference research at Modal. Own end-to-end bets on techniques like speculative decoding, quantization, KV-cache management, and disaggregation to improve cost per token and tail latency on production workloads. Requires strong LLM serving stack expertise and a track record shipping research or systems.
150k – 350k/yr
On-siteML Engineering
Member of Technical Staff, Model Training
ParallelCalifornia
Own the training pipeline for search and agent models, building from product usage data through fine-tuning and evaluation to production deployment. Requires deep expertise in transformer fine-tuning, data curation, and training models for ranking, retrieval, and agent behavior.
150k – 300k/yr
On-siteML Engineering
Member of Technical Staff, Search Ranking
ParallelUnited States
Own the multi-stage ranking pipeline for web-scale search, balancing precision, recall, latency, and compute cost across retrieval, first-pass ranking, and neural reranking.
150k – 300k/yr
On-site7+ YOEML Engineering
Staff Software Engineer, Engineering AI Team
Second NatureUnited States
Staff engineer builds AI-driven platform infrastructure for SDLC transformation, owns end-to-end experiments using AI agents like Claude, and ensures high-velocity code delivery with strong abstractions and real-world grounding. Requires staff-level architecture experience and AI-native workflows.