BasetenSan Francisco, CASenior Product Engineer - Training Platform
Senior engineer building AI training platform features like multi-node training and serverless RL. Owns full stack from API/UI to infrastructure, fine-tunes models, and collaborates with researchers. Requires 5+ years experience in software, distributed systems, and developer tools.
$200k – $275k/yr
On-site5+ YOEFullstack Engineering
About the job
Example Initiatives
- Checkpointing Pipeline: Automated checkpointing with seamless deployment to inference servers like vLLM.
- Multinode training: Kubernetes-based multi-node training for large models like GLM 4.7 and DeepSeek.
- Training DX: Enhanced metrics, CLI, and UI for fast iteration.
Responsibilities
- Iterate rapidly on features.
- Design ergonomic APIs and abstractions.
- Work throughout the stack (API, backend, database, infra; frontend plus).
- Fine-tune and deploy models.
- Partner with model developers and research engineers.
- Drive reliability and development velocity improvements.
- Fix bugs and resolve customer issues urgently.
Requirements
- 5+ years experience building software applications.
- Deep knowledge of web stack, databases, and distributed systems.
- Experience developing developer tooling or infrastructure products.
- Good taste in developer-oriented products.
- Interest in ML/AI infrastructure.
- High agency, ownership, and strong communication skills.
Nice to Have
- Experience launching features through release cycles (MVP, Beta, GA).
- Model development experience (SFT, RL, LoRA, etc.).
- Familiarity with training frameworks (PyTorch, DeepSpeed, NCCL, etc.) and distributed techniques (FSDP).
- AI products/tooling experience.
- Frontend fluency.
Benefits
- Competitive compensation with equity.
- 100% medical, dental, vision coverage.
- Generous PTO and Winter Break.
- Paid parental leave.
- 401(k).
Skills
KubernetesPyTorchDeepspeedDistributed SystemsAPIsDatabasesvLLMFsdpNcclReinforcement Learning
