Senior Product Engineer - Training Platform
Senior engineer building AI training platform features like multi-node training and serverless RL. Owns full stack from API/UI to infrastructure, fine-tunes models, and collaborates with researchers. Requires 5+ years experience in software, distributed systems, and developer tools.
About the job
Example Initiatives
- Checkpointing Pipeline: Automated checkpointing with seamless deployment to inference servers like vLLM.
- Multinode training: Kubernetes-based multi-node training for large models like GLM 4.7 and DeepSeek.
- Training DX: Enhanced metrics, CLI, and UI for fast iteration.
Responsibilities
- Iterate rapidly on features.
- Design ergonomic APIs and abstractions.
- Work throughout the stack (API, backend, database, infra; frontend plus).
- Fine-tune and deploy models.
- Partner with model developers and research engineers.
- Drive reliability and development velocity improvements.
- Fix bugs and resolve customer issues urgently.
Requirements
- 5+ years experience building software applications.
- Deep knowledge of web stack, databases, and distributed systems.
- Experience developing developer tooling or infrastructure products.
- Good taste in developer-oriented products.
- Interest in ML/AI infrastructure.
- High agency, ownership, and strong communication skills.
Nice to Have
- Experience launching features through release cycles (MVP, Beta, GA).
- Model development experience (SFT, RL, LoRA, etc.).
- Familiarity with training frameworks (PyTorch, DeepSpeed, NCCL, etc.) and distributed techniques (FSDP).
- AI products/tooling experience.
- Frontend fluency.
Benefits
- Competitive compensation with equity.
- 100% medical, dental, vision coverage.
- Generous PTO and Winter Break.
- Paid parental leave.
- 401(k).
Skills
Kubernetes, PyTorch, Deepspeed, Distributed Systems, APIs, Databases, vLLM, Fsdp, Nccl, Reinforcement Learning
Similar jobs
Fullstack Engineering jobs
Bluesky Social
United States
Build and maintain developer tools, API services, auth/identity systems, and delightful web experiences to support the AT Protocol and Bluesky's open network ecosystem. Requires 5+ years expertise in TypeScript, Node.js, React, backend services, and web auth technologies.
Greptile
San Francisco, CA
Build and operate full-stack systems for an AI code-review product, tackling LLM memory, code indexing, semantic search, and reliability challenges. The role requires 4+ years of software or DevOps engineering experience, JavaScript or TypeScript expertise, and a bachelor’s degree or equivalent.
Traba
New York, NYBuild and ship full-stack product systems powered by AI agents and frontier models, automating staffing marketplace workflows such as vetting, matching, and fulfillment. The role requires 5+ years of frontend and backend experience, production AI integration, and strong distributed-systems expertise.
Watershed
New York, NY
Build full-stack software that turns climate and carbon data into actionable intelligence for financial institution customers. The role requires 6+ years of software engineering experience, scalable product development skills, and preferably Node.js or data-pipeline experience.
Discord
United States
Builds and scales Discord’s advertising products and infrastructure across backend and frontend systems. The role requires 5+ years of experience, strong ownership, cross-functional collaboration, and expertise in technologies such as Python, Rust, TypeScript, React, or React Native.