Senior Software Engineer Together Cloud Infrastructure
Build backend infrastructure and IaaS services for a global AI cloud platform, including GPU virtualization, Kubernetes, storage, networking, and automated data-center operations. Requires at least five years of software development experience and strong systems expertise.
About the job
Responsibilities
- Design, build, and maintain performant, secure, and highly available backend services and operators that run in data centers and automate hardware management, including InfiniBand partitioning, in-DC parallel storage provisioning, and VM provisioning.
- Design and build the IaaS software layer for a new GB200 data center with thousands of GPUs.
- Work on a global, multi-exabyte high-performance object store serving massive datasets for pretraining.
- Build advanced observability stacks with automated node lifecycle management for fault-tolerant distributed pretraining.
- Perform architecture and research work for decentralized AI workloads.
- Work on the core, open-source Together AI platform.
- Create services, tools, and developer documentation.
- Create testing frameworks for robustness and fault tolerance.
Requirements
- 5+ years of professional software development experience.
- Proficiency in at least one backend programming language; Go is desired.
- 5+ years of experience writing high-performance, well-tested, production-quality code.
- Experience building and operating high-performance and/or globally distributed microservice architectures across one or more cloud providers.
- Excellent communication skills, including the ability to write clear design documents and work effectively with technical and non-technical team members.
- Strong systems knowledge and troubleshooting abilities.
- Kubernetes internals experience, including Kubernetes operators, device/storage/network plugins, custom schedulers, or Kubernetes patches, is a plus.
- Virtual machines and hypervisors experience, including QEMU/KVM, cloud-hypervisor, VFIO, virtio, PCIe passthrough, KubeVirt, or SR-IOV, is a plus.
- Data-center networking experience with VLAN, VXLAN, VPN, VPC, OVS, or OVN is a plus.
- Experience with Cluster API or similar systems is a plus.
- Experience with high-performance compute, networking, and/or storage is a plus.
- Experience virtualizing GPUs and/or InfiniBand is a plus.
- Strong systems knowledge across compute, networking, and storage, including concurrency, memory management, performant I/O, and scale.
- Experience with infrastructure automation tools, monitoring and observability stacks, and CI/CD pipelines.
- Experience building IaaS or PaaS systems at scale is a plus.
- Experience with DPUs or SmartNICs is a plus.
- GPU programming, NCCL, and CUDA knowledge is a plus.
Compensation and Benefits
- Hybrid working arrangement with two days per week in the Amsterdam office.
Skills
Go, Kubernetes, Qemu/Kvm, Vfio, Kubevirt, Sr-Iov, Vlan, Vxlan, Terraform, Ansible, Prometheus, Grafana, Argo CD, CUDA, Nccl
Similar jobs
Backend Engineering jobs
Phantom
Remote
Senior backend engineer designing scalable services and APIs that connect Phantom Cash to blockchain networks. The role requires Node.js/NestJS, REST API, event-driven, and distributed-systems expertise, with blockchain or fintech experience preferred.
Hospitable
United StatesBuild and evolve Hospitable’s core and growth platform in Laravel and PHP, delivering customer-focused features, reliable production systems, and maintainable code. The role requires 5+ years of backend engineering experience, strong Laravel expertise, and comfort using AI coding tools in production.
Fingerprint
Remote
Build and operate highly performant Core API services for real-time fraud detection, owning reliability, observability, scaling, and production operations. The role requires 5+ years of backend experience with Go or Node.js and strong SRE practices.
Fortanix
Eindhoven, NetherlandsBuild and scale Rust backend services for a cybersecurity product integrating with cloud platforms, databases, and enterprise systems. The role requires 8+ years of backend engineering experience, strong Rust, C++, or Go skills, and ownership across design, delivery, deployment, and production support.
Vanta
Remote
Build and operate the backend runtime platform that schedules, executes, and persists security and compliance tests at scale. The role requires strong production systems experience, ownership of complex projects, debugging expertise, and effective technical collaboration and mentorship.