Architects and leads development of scalable ML training infrastructure, including scheduling, storage, networking, and reinforcement learning systems. Requires proficiency in Go, Kubernetes expertise, distributed systems knowledge, and experience with cloud providers and ML workloads.
165k – 330k/yr
HybridML Engineering
About the role
Responsibilities
Design and architect scalable infrastructure systems for our ML training platform (e.g. scheduling, storage, and networking)
Partner closely with developers and research engineers to translate complex training requirements into technical solutions
Design and architect a global training scheduler
Design and architect reinforcement learning systems and continuous learning pipelines
Drive long-term improvements to improve reliability of systems and velocity of development
Partner closely with SRE and Capacity teams to unlock state of the art training infrastructure
Make critical architectural decisions balancing performance with system reliability
Lead technical discussions and mentor junior engineers on infrastructure best practices
Contribute to long-term technical strategy and infrastructure roadmap
Requirements
Bachelor’s degree or higher in Computer Science or related field
Proficiency in Go, with Python experience a plus
Deep expertise with Kubernetes in production environments
Extensive experience with major cloud providers (AWS, GCP) and neo-cloud providers (Crusoe, DigitalOcean, Nebius) a plus
Advanced understanding of distributed systems concepts and performance tuning
Proven experience designing observability systems
Experience with ML/AI workloads and MLOps platforms highly valued
Nice to Have
Experience with distributed storage systems
Experience with workload orchestration platforms like Temporal or Airflow
Familiarity or experience with the open source training stack and frameworks (NCCL, PyTorch, Megatron, NemoRL, VeRL, Axolotl, HF Trainer) and distributed training techniques (FSDP, DeepSpeed)
Experience developing AI products, tooling, or agents
Benefits
Competitive compensation, including meaningful equity
100% coverage of medical, dental, and vision insurance for employee and dependents
Generous PTO policy including company wide Winter Break
Build and own high-performance inference runtime for Voice AI models including STT, TTS, and voice agents. Design real-time systems with low tail latency, collaborate cross-team, and optimize model serving for production workloads. Requires CS degree and real-time systems experience.
165k – 330k/yr
HybridML Engineering
Forward Deployed Engineer, Deepgram for Restaurants
DeepgramNew York, NY
Deploys and integrates Deepgram’s voice AI platform into enterprise restaurant environments, owning technical implementations, customizations, production support, and feedback to product teams. Requires strong software engineering skills across APIs, SDKs, cloud infra, and customer obsession.
165k – 220k/yr
RemoteML Engineering
Software Engineer, AI/ML
TabsNew York, NY
Build full stack AI/ML features for finance automation platform, owning greenfield projects with Python/TypeScript/Next.js. Requires 3-5 years full stack exp, 1+ year AI/ML inference, in-person NYC.
165k – 225k/yr
On-site3+ YOEML Engineering
Fullstack Software Engineer, Applied AI
LangChainNew York, NY +2
Builds and deploys production-grade AI agents and workflows for business functions like marketing, recruiting, and product. Requires 3+ years experience shipping AI/ML apps, including LLM systems, with strong Python/TypeScript skills.
165k – 190k/yr
On-site3+ YOEML Engineering
Software Engineer, AI Growth
BenchlingSan Francisco, CA
Builds end-to-end product experiences to drive AI adoption among scientists, focusing on onboarding, experimentation, and growth loops. Requires 5+ years full-stack experience with React/Python, strong product intuition, and analytics skills.