AI Platform Support Engineer
Supports technical customers running production ML workloads by troubleshooting distributed systems, Kubernetes, GPU infrastructure, and inference platforms. The role also drives reliability improvements, tooling, observability, and operational guidance across platform teams.
About the job
Responsibilities
Customer and Engineering Support
- Partner directly with customer engineering teams running training and inference workloads in production.
- Diagnose and resolve complex distributed-systems and ML-infrastructure issues.
- Advise customers during high-impact incidents and platform degradation events.
- Translate infrastructure-level issues into actionable guidance for ML engineers.
- Build credibility with customers through strong technical reasoning and clear communication.
ML Infrastructure and Distributed Workloads
- Investigate failures involving distributed training, Kubernetes orchestration, GPU allocation, networking, and storage systems.
- Troubleshoot PyTorch, CUDA, NCCL, and inference-serving issues.
- Analyze logs, metrics, traces, and system behavior to isolate root causes.
- Debug containerized workloads across Kubernetes and bare-metal GPU environments.
- Support customers scaling workloads across multi-node GPU systems.
- Diagnose performance bottlenecks involving compute, memory, networking, or storage.
Reliability and Platform Operations
- Identify recurring patterns across customer issues and drive long-term reliability improvements.
- Contribute to post-incident reviews and operational improvements.
- Build internal tooling, automation, documentation, and runbooks.
- Partner with infrastructure, networking, and platform engineering teams.
- Improve observability, operational visibility, troubleshooting workflows, and customer experience.
Requirements
- Strong software-engineering and systems-troubleshooting background.
- Experience with Kubernetes and containerized environments.
- Linux knowledge, including networking, storage, process management, and performance tuning.
- Experience with cloud infrastructure and distributed systems.
- Experience with observability and debugging tools such as Prometheus, Grafana, or OpenTelemetry.
- Hands-on experience operating machine-learning workloads in production or research environments.
- Experience with distributed ML systems and tooling such as PyTorch, CUDA, or NCCL.
- Familiarity with GPU infrastructure and orchestration.
- Experience troubleshooting performance, reliability, or scaling issues in ML infrastructure.
- Understanding of the operational challenges involved in running ML systems at scale.
- Strong communication skills and ability to work directly with technical customers and engineering teams.
- Comfortable operating in fast-moving, highly ambiguous environments.
Nice-to-Haves
- Experience with large-scale model training or distributed inference systems.
- Familiarity with Ray, Kubeflow, Slurm, or similar distributed scheduling platforms.
- Experience with InfiniBand, RDMA, or high-performance networking.
- Experience operating bare-metal infrastructure.
- Familiarity with storage systems commonly used in ML environments.
- Experience at an AI infrastructure, cloud, MLOps, or developer-tooling company.
- Contributions to platform engineering, developer infrastructure, or operational tooling projects.
- Experience writing automation, tooling, or scripts in Python or similar languages.
Benefits and Compensation
- Medical, dental, and vision coverage for employees and eligible dependents.
- RSUs and retirement savings benefits, including 401(k) matching in the U.S. and pension contributions in the U.K.
- Unlimited PTO, company holidays, floating holidays, and a two-week company-wide winter break.
- Paid parental and family leave.
- Annual learning and development allowance.
- Wellness and work-from-home stipends.
- Four weeks of paid sabbatical leave after four years of service.
- Flexible schedules and a hybrid work model for office-based teams.
- Complimentary meals at office hubs.
Benefits may vary by location, team, and role.
Skills
Kubernetes, Linux, Distributed Systems, Cloud Infrastructure, Prometheus, Grafana, OpenTelemetry, PyTorch, CUDA, Nccl, Gpu Infrastructure, Ray, Kubeflow, Slurm, Python
Similar jobs
Support Engineering jobsSupports hybrid and self-hosted customer deployments by troubleshooting Kubernetes, cloud infrastructure, networking, backend performance, and reliability issues. The role combines technical customer support, incident response, coding fixes, and diagnostic tooling across major cloud platforms.
Provides expert technical support to enterprise customers, troubleshooting complex platform issues, managing incidents and SLAs, and improving support tooling and processes. Requires 4+ years in technical or developer support, strong debugging skills, and familiarity with APIs, databases, and CI/CD.
Provides high-priority technical support to Premium customers, diagnosing complex platform issues, coordinating incidents with Engineering and Product, and improving support tooling and processes. Requires 3+ years of technical support or systems engineering experience plus strong JavaScript or Python debugging skills.
Provides technical support, product implementation, integrations, and customer guidance for OPSWAT solutions in the UK. The role requires strong Windows expertise, troubleshooting and communication skills, customer orientation, and willingness to travel.
Supports developers and businesses using PlanetScale by troubleshooting production application and database issues, improving documentation, and translating recurring customer pain into product and process improvements. Requires SQL knowledge, programming experience, and strong technical communication.