# Principal Systems Software Engineer

**Company:** [Crusoe](https://hotfix.jobs/companies/crusoe)
**Location:** San Francisco, CA
**Role:** Backend Engineering
**Salary:** $260k – $340k/yr
**Experience:** 12+ years
**Skills:** linux kernel, kvm, qemu, firecracker, Kubernetes, slurm, InfiniBand, rdma, roce v2, sr-iov, gpu scheduling, nvidia gpus, amd gpus, C++
**Posted:** 2026-08-05

> Leads the architecture and delivery of hyperscale AI infrastructure spanning bare metal, virtualization, containers, kernel I/O, and high-performance networking. Requires 12+ years of infrastructure experience, deep Linux and virtualization expertise, GPU/NIC optimization, and significant technical leadership or industry contributions.

## Job Description

## Responsibilities
- Architect systems for Bare-Metal-as-a-Service (BMaaS), delivering GPU throughput through InfiniBand/RDMA fabrics for large-scale training.
- Design optimized virtualization layers using KVM or custom micro-VMs, providing enterprise-grade isolation with minimal virtualization overhead.
- Build a high-performance container substrate using Kubernetes or Slurm for AI workloads across heterogeneous GPU nodes.
- Lead architectural design for SR-IOV, RDMA, and virtualized GPU scheduling.
- Lead R&D workstreams to productionize novel approaches to memory, networking, and compute management.
- Draft white papers and RFCs defining the compute and networking stack roadmap.
- Debug complex I/O-path race conditions and optimize kernel-level memory pinning for GPU clusters.
- Represent the company in open-source communities and industry forums.

## Requirements
- 12+ years of experience designing and shipping core infrastructure at a major hyperscaler or specialized HPC cloud.
- Authoritative knowledge of the Linux kernel, virtualization internals, KVM, QEMU, Firecracker, and high-performance networking including RoCE v2 and InfiniBand.
- Experience designing software that maximizes NVIDIA or AMD GPU and high-speed NIC performance.
- Experience leading cross-functional teams through ambiguous projects and delivering production-ready, mission-critical systems.
- Significant contributions to the field through patents, major open-source contributions, or published distributed-systems research.
- Excellent communication skills, including explaining systems concepts to technical and executive audiences.
- Bachelor's or master's degree in Computer Science, Computer Engineering, or a related analytical field, or equivalent professional experience.

## Nice-to-haves
- Patents related to network virtualization, GPU scheduling, or distributed file systems.
- Maintainer status or significant contributions to the Linux kernel, Kubernetes, or specialized HPC projects.
- Experience optimizing infrastructure for large language model training and inference at scale.
- Peer-reviewed publications at systems venues such as OSDI, SOSP, NSDI, or SC.
- IETF RFCs, significant open-source contributions, or industry white papers on distributed systems, high-performance networking, or AI infrastructure.

## Compensation and Benefits
- Compensation range: **$260,000–$340,000**, plus significant equity and bonus.
- Restricted Stock Units.
- Paid time off and paid holidays.
- Comprehensive health, dental, and vision insurance.
- Employer HSA contributions.
- Paid parental leave.
- Paid life insurance and short- and long-term disability coverage.
- Professional development and tuition reimbursement.
- Mental health and wellness support.
- Commuter benefits for parking and transit.
- Cell phone stipend.
- 401(k) retirement plan with company match up to 4% of salary.
- Volunteer time off.

## Similar roles

- [Principal Software Engineer I - Metadata](https://hotfix.jobs/jobs/8851fa3b-008f-4f5e-93f9-ca01a0ea30b6) - Snowflake - Menlo Park, CA - $264k – $380k/yr
- [Principal Software Engineer I - Snowhouse Foundation](https://hotfix.jobs/jobs/eab67d12-c617-42e1-9ef4-0e6de3eb7c9c) - Snowflake - Menlo Park, CA - $264k – $380k/yr
- [Principal Software Engineer, Applied AI](https://hotfix.jobs/jobs/b2a2e9b1-4cc0-417b-b015-df109bc4c6ca) - Invisible Tech - New York, NY - $250k – $366k/yr
- [Principal Software Engineer, Money Infrastructure](https://hotfix.jobs/jobs/2f82d675-f4ad-4c53-b685-c1a5f6532852) - Replit - Foster City, CA - $250k – $340k/yr
- [Principal Software Engineer](https://hotfix.jobs/jobs/674dfff7-f5c7-4913-977f-cece47200073) - Astronomer - New York, NY - $277k – $390k/yr

**Apply:** https://hotfix.jobs/jobs/7844fdf3-59e3-4482-a8b8-45ffcd74bd2f
**Canonical:** https://hotfix.jobs/jobs/7844fdf3-59e3-4482-a8b8-45ffcd74bd2f