Skip to content
Scale AIScale AISan Francisco, CA

ML Research Engineer, ML Systems

Builds and optimizes distributed frameworks for LLM training and inference on Scale's RLXF platform. Collaborates with ML teams to accelerate research, requiring expertise in PyTorch, CUDA, transformers, and large-scale distributed systems.

218k – 273k
On-siteML Engineering

About the role

You will:

  • Build, profile and optimize our training and inference framework
  • Collaborate with ML teams to accelerate their research and development and enable them to develop the next generation of models and data curation
  • Research and integrate state-of-the-art technologies to optimize our ML system

Ideally you’d have:

  • Strong excitement about system optimization
  • Experience with multi-node LLM training and inference
  • Experience with developing large-scale distributed ML systems
  • Strong software engineering skills, proficient in frameworks and tools such as CUDA, PyTorch, transformers, flash attention, etc.
  • Strong written and verbal communication skills and the ability to operate in a cross functional team environment

Nice to haves:

  • Demonstrated expertise in post-training methods or next generation use cases for large language models including instruction tuning, RLHF, tool use, reasoning, agents, and multimodal, etc.

Skills

PyTorchCUDATransformersFlash AttentionLlm TrainingDistributed Ml SystemsRLHFMulti-Node TrainingMl InferenceSystem Optimization

Similar roles

ML Engineering jobs
Scale AI

ML Systems Engineer, Robotics

Scale AISan Francisco, CA

Designs and builds scalable platforms for serving foundation models in robotics and autonomous vehicles. Requires 4+ years in ML infrastructure, backend systems, GPU optimization, and cloud technologies.

218k – 273k
On-site4+ YOEML Engineering
Scale AI

Machine Learning Research Engineer, Agent Data Foundation - Enterprise GenAI

Scale AISan Francisco, CA +2

Develops synthetic data pipelines, production trace agents, and automated agent-building frameworks for enterprise GenAI. Requires 3+ years LLM production experience, top conference publications, and advanced CS degree.

218k – 273k
Hybrid3+ YOEML Engineering
Perplexity

AI Engineer, Applied ML

PerplexitySan Francisco, CA +2

Designs, builds, and iterates on AI/ML models for personalization, query understanding, and content discovery. Requires 5+ years in ML, deep learning expertise (PyTorch/TensorFlow/JAX), Python, and full ML lifecycle ownership.

220k – 405k
On-site5+ YOEML Engineering
Perplexity

AI Inference Engineer

PerplexitySan Francisco, CA +2

Develops APIs and optimizes large-scale ML model inference using Python, Rust, C++, PyTorch, and CUDA. Benchmarks performance, improves reliability, and implements LLM optimizations on GPU architectures.

220k – 405k
On-siteML Engineering
Scale AI

Software Engineer, Enterprise AI

Scale AINew York, NY +1

Build and scale enterprise Generative AI platform, owning large product areas across backend, frontend, LLMs, and ML models. Requires 4+ years experience, proficiency in Python/JavaScript/SQL, Kubernetes, and cloud providers.

216k – 270k
On-site4+ YOEML Engineering