Skip to content
SnowflakeSnowflakeBellevue, WA

Senior Software Engineer — LLM Post-Training Platform

Build and scale Snowflake's Cortex Training LLM post-training platform, handling distributed GPU scheduling, orchestration, and productionizing research for enterprise-scale model adaptation.

200k – 288k/yr
On-site5+ YOEML Engineering

About the role

Responsibilities

  • Design and build across the full stack — from the public training APIs and SDK through the control plane to the GPU data plane.
  • Scale the distributed systems that make GPU compute serverless — multi-tenant scheduling, placement, and capacity-aware routing across regional GPU pools, with fault tolerance built in.
  • Drive end-to-end performance at scale — keep the training, inference, and RL loops fast and the data plane responsive under heavy concurrent load, with GPUs kept saturated.
  • Productionize research building blocks — partner with Snowflake Research to turn state-of-the-art training and inference techniques into reliable, composable components customers can run at enterprise scale.

Requirements

  • 5+ years building and shipping production ML systems
  • Strong distributed systems and infrastructure foundation — designing scalable, fault-tolerant services and operating them on Kubernetes in production
  • Familiarity with GPU and LLM infrastructure — e.g., PyTorch, DeepSpeed/FSDP, Ray, CUDA/NCCL, vLLM; able to debug across the data, infrastructure, and GPU layers
  • Demonstrated ability to harden complex systems for reliability, throughput, and cost efficiency
  • BS in Computer Science or a related field (MS/PhD a plus)

Nice-to-Haves

  • Hands-on LLM post-training / modeling experience — the strongest candidates pair deep infra skills with real post-training intuition

Skills

PyTorchDeepspeedFsdpRayCUDANcclvLLMKubernetesDistributed SystemsLlm Post-Training

Similar roles

ML Engineering jobs
Traba

Senior Software Engineer

TrabaNew York, NY +1

Build and own production AI agent systems (harnesses, evals, orchestration) on frontier LLMs for industrial supply chain workflows at Traba. Requires 5+ years software engineering with 1+ year shipping LLM/agent features, strong Python/TS, and high-agency customer immersion.

200k – 240k/yr
Hybrid5+ YOEML Engineering
Roger Healthcare

Senior Applied AI Engineer

Roger HealthcareSan Francisco, CA

Senior Applied AI Engineer building the core intelligence layer for Roger, an AI platform for home health clinicians. Responsibilities include training/fine-tuning LLMs on proprietary clinical data, building rigorous eval and monitoring systems, and shipping reliable agentic LLM workflows that improve patient care.

200k – 250k/yr
On-site7+ YOEML Engineering
Astronomer

Senior Software Engineer, Build

AstronomerNew York, NY

Build and scale Astronomer's AI-powered global context layer for data, focusing on semantic search, retrieval, code generation, and applied AI for data engineering workflows. Requires 5+ years software engineering experience with Python or Go, plus strong interest in LLMs and data tools.

200k – 230k/yr
Hybrid5+ YOEML Engineering
Current

Senior Software Engineer, Applied ML

CurrentNew York, NY

Senior Software Engineer applying ML/AI techniques to fintech problems like fraud detection and user conversion. Requires 5+ years backend engineering (Java/JVM) and 2+ years deploying production ML models.

200k – 250k/yr
On-site5+ YOEML Engineering
Socure

Senior AI Engineer

SocureCarson City, NV +1

Build and deploy production-grade agentic AI systems and automation workflows that drive efficiency across sales, marketing, finance, and other business functions. Partner with stakeholders to identify high-impact use cases and deliver reliable, observable LLM-powered solutions.

200k – 230k/yr
Hybrid8+ YOEML Engineering