# Operations Engineer, HPC Networking

**Company:** [Fal](https://hotfix.jobs/companies/fal)
**Location:** Remote
**Role:** DevOps / SRE
**Skills:** InfiniBand, Ethernet, Nccl, Subnet Manager, Hcas, Switch Firmware, Roce, Spectrum-X, Bash, Python, Go, Gpu Cluster Networking
**Posted:** 2026-05-14

> Hands-on operations engineer maintaining and troubleshooting high-performance InfiniBand and Ethernet networking fabrics in large-scale GPU clusters. Requires production experience with subnet management, full-stack debugging, fabric bring-up, and scripting.

## Job Description

## Responsibilities
- Monitor health and performance of InfiniBand and Ethernet fabrics: switches, HCAs, transceivers, links.
- Investigate and resolve fabric issues: connectivity, congestion, performance regressions.
- Support fabric bring-up alongside DC ops and customer-facing teams.
- Run maintenance and upgrades on switches and control plane components.
- Partner with cluster ops on cross-domain incidents where the line between compute and network is blurry.
- Improve the tooling and runbooks so the next incident resolves faster.

## Requirements
- Operated InfiniBand fabrics in production: subnet manager, routing, partitioning, monitoring.
- Debugged the full stack: cables, transceivers, switch firmware, HCAs, drivers, NCCL.
- Brought up new fabrics from cable pull through validation.
- Scripted your way through repetitive operational work (**bash**, **python**, **go**).

## Nice to Have
- Ethernet RoCE, Spectrum-X, or large-scale GPU cluster networking.

## Similar roles

- [Software Engineer, Platform & Infrastructure](https://hotfix.jobs/jobs/2a4d6818-4e00-4a08-8339-aba841ed1ada) - Forus - New York, NY
- [Software Engineer, Developer Productivity](https://hotfix.jobs/jobs/3d3eb78d-cb73-4b62-bef0-6c84085fdf5a) - Forus - New York, NY
- [Site Reliability Engineer](https://hotfix.jobs/jobs/8def48bc-b809-4397-bd55-28b9747c1f82) - Runloop - San Francisco, CA
- [Build & Release Engineer](https://hotfix.jobs/jobs/c41c87c5-6007-46e9-8648-635789c39b4a) - Applied Intuition - Sunnyvale, CA - $118k – $200k/yr
- [Software Engineer, Async Platform](https://hotfix.jobs/jobs/f1db6fa3-5b80-4939-86b0-39e6f0db0694) - Lyft - Seattle, WA - $118k – $147k/yr

**Apply:** https://hotfix.jobs/jobs/753975fd-6ada-4513-9160-8f3b456619a5
**Canonical:** https://hotfix.jobs/jobs/753975fd-6ada-4513-9160-8f3b456619a5