Senior Staff Software Engineer, DC Infrastructure

Responsibilities

• Develop deep-level diagnostics and troubleshooting for hardware faults within GPU racks and high-density compute systems.
• Build troubleshooting and automation tooling for NVIDIA A100, H200, GB200, B200, and AMD 350X/355X GPU platforms.
• Develop automation and AI agents for component-level diagnosis and remediation of failed or degraded hardware.
• Partner with data center operations to create tooling and AI agents for managing critical environments.
• Develop post-repair validation and testing tools, including burn-in, PyTorch, and NVIDIA NCCL, to ensure system stability and performance.
• Own deployment, monitoring, and operational support for developed tooling to maximize GPU fleet availability and performance.
• Develop automation and operational tooling for facility power and direct liquid-cooling hardware systems.
• Set technical direction for projects and execute scalable solutions.
• Support teammates working on critical or complex technical initiatives.

Requirements

• Software engineering experience.
• Experience with distributed systems, reliability, and cloud platforms.
• Experience with Kubernetes, infrastructure as code, and Google Cloud.
• Proficiency in at least one of Go, Python, Java, or Rust.
• Strong analytical, problem-solving, communication, and collaboration skills.
• Ability to work independently and within a team.

Nice to Have

• Experience with Temporal and Kubernetes.
• Experience working directly with hardware vendors.
• Experience operating large-scale GPU fleets or hyperscale data center environments.

Compensation and Benefits

• Compensation range of $250,000–$300,000 plus bonus.
• Restricted Stock Units included in all offers.
• Health insurance options including HDHP and PPO, vision, and dental coverage for employees and dependents.
• Employer HSA contributions.
• Paid parental leave.
• Paid life insurance and short- and long-term disability coverage.
• Teladoc.
• 401(k) with a 100% match up to 4% of salary.
• Generous paid time off and holiday schedule.
• Cell phone reimbursement.
• Tuition reimbursement.
• Calm app subscription.
• MetLife Legal.
• Company-paid commuter benefit of $300 per month.