Senior Product Engineer - Training Platform

Example Initiatives

• Checkpointing Pipeline: Automated checkpointing with seamless deployment to inference servers like vLLM.
• Multinode training: Kubernetes-based multi-node training for large models like GLM 4.7 and DeepSeek.
• Training DX: Enhanced metrics, CLI, and UI for fast iteration.

Responsibilities

• Iterate rapidly on features.
• Design ergonomic APIs and abstractions.
• Work throughout the stack (API, backend, database, infra; frontend plus).
• Fine-tune and deploy models.
• Partner with model developers and research engineers.
• Drive reliability and development velocity improvements.
• Fix bugs and resolve customer issues urgently.

Requirements

• 5+ years experience building software applications.
• Deep knowledge of web stack, databases, and distributed systems.
• Experience developing developer tooling or infrastructure products.
• Good taste in developer-oriented products.
• Interest in ML/AI infrastructure.
• High agency, ownership, and strong communication skills.

Nice to Have

• Experience launching features through release cycles (MVP, Beta, GA).
• Model development experience (SFT, RL, LoRA, etc.).
• Familiarity with training frameworks (PyTorch, DeepSpeed, NCCL, etc.) and distributed techniques (FSDP).
• AI products/tooling experience.
• Frontend fluency.

Benefits

• Competitive compensation with equity.
• 100% medical, dental, vision coverage.
• Generous PTO and Winter Break.
• Paid parental leave.
• 401(k).