# Senior Software Engineer Together Cloud Infrastructure

**Company:** [Together AI](https://hotfix.jobs/companies/together-ai)
**Location:** Amsterdam, Netherlands
**Role:** Backend Engineering
**Experience:** 5+ years
**Skills:** Go, Kubernetes, Qemu/Kvm, Vfio, Kubevirt, Sr-Iov, Vlan, Vxlan, Terraform, Ansible, Prometheus, Grafana, Argo CD, CUDA, Nccl
**Posted:** 2026-07-10

> Build backend infrastructure and IaaS services for a global AI cloud platform, including GPU virtualization, Kubernetes, storage, networking, and automated data-center operations. Requires at least five years of software development experience and strong systems expertise.

## Job Description

## Responsibilities

- Design, build, and maintain performant, secure, and highly available backend services and operators that run in data centers and automate hardware management, including InfiniBand partitioning, in-DC parallel storage provisioning, and VM provisioning.
- Design and build the IaaS software layer for a new GB200 data center with thousands of GPUs.
- Work on a global, multi-exabyte high-performance object store serving massive datasets for pretraining.
- Build advanced observability stacks with automated node lifecycle management for fault-tolerant distributed pretraining.
- Perform architecture and research work for decentralized AI workloads.
- Work on the core, open-source Together AI platform.
- Create services, tools, and developer documentation.
- Create testing frameworks for robustness and fault tolerance.

## Requirements

- 5+ years of professional software development experience.
- Proficiency in at least one backend programming language; Go is desired.
- 5+ years of experience writing high-performance, well-tested, production-quality code.
- Experience building and operating high-performance and/or globally distributed microservice architectures across one or more cloud providers.
- Excellent communication skills, including the ability to write clear design documents and work effectively with technical and non-technical team members.
- Strong systems knowledge and troubleshooting abilities.
- Kubernetes internals experience, including Kubernetes operators, device/storage/network plugins, custom schedulers, or Kubernetes patches, is a plus.
- Virtual machines and hypervisors experience, including QEMU/KVM, cloud-hypervisor, VFIO, virtio, PCIe passthrough, KubeVirt, or SR-IOV, is a plus.
- Data-center networking experience with VLAN, VXLAN, VPN, VPC, OVS, or OVN is a plus.
- Experience with Cluster API or similar systems is a plus.
- Experience with high-performance compute, networking, and/or storage is a plus.
- Experience virtualizing GPUs and/or InfiniBand is a plus.
- Strong systems knowledge across compute, networking, and storage, including concurrency, memory management, performant I/O, and scale.
- Experience with infrastructure automation tools, monitoring and observability stacks, and CI/CD pipelines.
- Experience building IaaS or PaaS systems at scale is a plus.
- Experience with DPUs or SmartNICs is a plus.
- GPU programming, NCCL, and CUDA knowledge is a plus.

## Compensation and Benefits

- Hybrid working arrangement with two days per week in the Amsterdam office.

## Similar jobs

- [Senior Software Engineer, Backend (Money Movement)](https://hotfix.jobs/jobs/8afb425b-fe94-4b6b-8b26-f8dde0de4f58) - Phantom - Remote
- [Senior Product Engineer](https://hotfix.jobs/jobs/70578999-e62a-4d80-b444-491e7a0d3c08) - Hospitable - Remote - $134k – $167k/yr
- [Senior Backend Engineer, Core APIs](https://hotfix.jobs/jobs/81121cc0-579a-4c8d-ae6f-accddd1b2195) - Fingerprint - Remote - $150k – $200k/yr
- [Senior Software Engineer - Backend](https://hotfix.jobs/jobs/f456b753-a2ec-49c8-b0ce-7053899814d3) - Fortanix - Eindhoven, Netherlands
- [Senior Software Engineer, Test Core](https://hotfix.jobs/jobs/f33409a0-62e5-4cca-9887-eb5fbd75e55f) - Vanta - Remote - $195k – $229k/yr

**Apply:** https://hotfix.jobs/jobs/3dc91fbb-7c71-4f54-9e9a-6cd325b082b4
**Canonical:** https://hotfix.jobs/jobs/3dc91fbb-7c71-4f54-9e9a-6cd325b082b4