# Operations Engineer, Fleet Reliability

**Company:** [Fal](https://hotfix.jobs/companies/fal)
**Location:** Remote
**Role:** DevOps / SRE
**Skills:** Linux, GPU, Nvlink, Nccl, InfiniBand, Grafana, Prometheus, Bash, Python, Go
**Posted:** 2026-05-14

> Hands-on operations engineer maintaining GPU clusters (B300, H200, H100), troubleshooting hardware/software issues, monitoring fleet health, and automating runbooks. Requires Linux admin, GPU debugging, observability tools experience, and on-call comfort.

## Job Description

## Responsibilities
- Provision, validate, and triage GPU nodes across B300, H200, and H100 clusters
- Troubleshoot hardware and software issues across compute, network, and storage
- Monitor fleet health, take remediation action, push fixes upstream when needed
- Write the runbooks. Improve the ones that exist. Delete the ones that don't work

## Requirements
- Administered Linux Systems in the critical path before
- Troubleshooted GPU node issues: NVLink, NCCL, IB, driver and firmware bugs
- Has experience in observability systems like Grafana and Prometheus
- Scripted your way out of repetitive work (bash, python, go, whatever)
- Curious. You don't accept "it's flaky" as a root cause
- Comfortable with ambiguity. The runbook doesn't exist yet for half of what you'll do
- On-call doesn't scare you
- You'd rather automate a problem than fix it twice

## Similar roles

- [Software Engineer, Platform & Infrastructure](https://hotfix.jobs/jobs/2a4d6818-4e00-4a08-8339-aba841ed1ada) - Forus - New York, NY
- [Software Engineer, Developer Productivity](https://hotfix.jobs/jobs/3d3eb78d-cb73-4b62-bef0-6c84085fdf5a) - Forus - New York, NY
- [Site Reliability Engineer](https://hotfix.jobs/jobs/8def48bc-b809-4397-bd55-28b9747c1f82) - Runloop - San Francisco, CA
- [Build & Release Engineer](https://hotfix.jobs/jobs/c41c87c5-6007-46e9-8648-635789c39b4a) - Applied Intuition - Sunnyvale, CA - $118k – $200k/yr
- [Software Engineer, Async Platform](https://hotfix.jobs/jobs/f1db6fa3-5b80-4939-86b0-39e6f0db0694) - Lyft - Seattle, WA - $118k – $147k/yr

**Apply:** https://hotfix.jobs/jobs/40e46748-5f94-4d69-8aa1-5e4f8e81c1eb
**Canonical:** https://hotfix.jobs/jobs/40e46748-5f94-4d69-8aa1-5e4f8e81c1eb