Skip to content
Fireworks AIFireworks AISan Mateo, CA

Member of Technical Staff, AI Training Infrastructure

Builds and optimizes scalable infrastructure for AI model training on large GPU clusters. Requires expertise in distributed systems, Python/C++, and ML frameworks.

175k – 220k/yr
On-siteDevOps / SRE

About the role

Responsibilities

  • Design, build, and maintain scalable infrastructure for AI model training pipelines.
  • Optimize distributed training systems for large-scale GPU clusters.
  • Collaborate with AI researchers and engineers to deploy training workflows efficiently.

Requirements

  • Strong experience with distributed systems and high-performance computing.
  • Proficiency in Python, C++, and infrastructure-as-code tools.
  • Deep knowledge of AI training frameworks and GPU optimization.

Nice-to-Haves

  • Experience with Kubernetes and cloud platforms like AWS or GCP.
  • Background in machine learning operations (MLOps).

Skills

PythonC++KubernetesDistributed SystemsGpu ProgrammingPyTorchTensorFlowMLOpsAWSGCP

Similar roles

DevOps / SRE jobs
Sage

Senior/Staff Site Reliability Engineer

SageNew York, NY

Leads design, operation, and evolution of highly reliable, scalable production infrastructure including cloud, databases, and observability. Drives incident response, SRE practices, automation, and capacity planning for large-scale distributed systems. Requires 7-12+ years in SRE/infrastructure engineering.

175k – 230k/yr
Hybrid7+ YOEDevOps / SRE
Fireworks AI

Member of Technical Staff, Performance Optimization

Fireworks AISan Mateo, CA

Optimizes performance of high-scale systems by analyzing latency, throughput, and resource usage. Requires expertise in profiling, systems programming, and distributed scaling techniques.

175k – 220k/yr
On-siteDevOps / SRE
Fireworks AI

Member of Technical Staff, Cloud Infrastructure

Fireworks AINew York, NY +1

Builds and maintains scalable cloud infrastructure, focusing on reliability and performance. Requires expertise in cloud platforms, IaC tools like Terraform and Kubernetes, and systems programming.

175k – 220k/yr
HybridDevOps / SRE
Rad AI

Staff Software Engineer, Infrastructure

Rad AIUnited States

Designs and operates scalable cloud infrastructure on AWS, focusing on Kubernetes orchestration, reliability practices, and observability for AI healthcare products. Requires 8+ years experience with IaC, containerization, and cross-team leadership.

175k – 230k/yr
Remote8+ YOEDevOps / SRE
Grafana Labs

Staff Software Engineer

Grafana LabsUnited States

Staff Platform SysEng building and scaling the Internal Engineering Platform (Kubernetes clusters, infrastructure, tools) that powers Grafana Cloud services (Mimir, Loki, Tempo). Requires proven large-scale distributed systems leadership, cloud-native expertise, reliability ownership, and Go/Python coding.

175k – 210k/yr
Remote7+ YOEDevOps / SRE