Backend Engineer - API
Build and operate the high-throughput API and model-serving infrastructure powering SpaceXAI’s production inference systems. The role requires expert Rust or C++ knowledge, distributed-systems experience, and strong reliability and observability practices.
About the job
Responsibilities
- Build the SpaceXAI API that serves models to developers worldwide.
- Own the end-to-end system for high-throughput inference, handling billions of tokens per minute with low latency and high availability.
- Develop and maintain model-serving infrastructure, request routing, SDKs, rate limiting, observability, and efficient scaling.
Requirements
- Expert knowledge of Rust or C++.
- Experience designing, implementing, and maintaining reliable, horizontally scalable distributed systems.
- Knowledge of service observability and reliability best practices.
- Experience operating databases such as PostgreSQL, ClickHouse, and MongoDB.
Nice-to-haves
- Experience with LLM inference engines and serving frameworks such as SGLang, TensorRT, or vLLM.
- Experience designing or building with agent SDKs and agent orchestration frameworks.
- Experience with Docker, Kubernetes, and containerized applications.
- Expert knowledge of gRPC, including unary, response streaming, bidirectional streaming, and REST mapping.
Compensation and Benefits
- Base salary: £107,000–£262,000 GBP.
- Equity.
- Comprehensive healthcare and dental coverage.
- Cash plan.
- Income protection.
- Life insurance.
- Other discounts and perks.
Skills
Rust, C++, Distributed Systems, Postgres, ClickHouse, MongoDB, Llm Inference, Sglang, TensorRT, vLLM, Agent Sdks, Docker, Kubernetes, gRPC
Similar jobs
Backend Engineering jobs
xAI
London, United Kingdom
Build scalable backend services and payment infrastructure for a global financial products platform. The role requires distributed-systems expertise, proficiency in modern programming languages, and experience with large-scale consumer applications.
xAI
London, United Kingdom
Build and maintain secure sandbox infrastructure that lets AI models execute code and interact with tools in controlled virtualized environments. The role requires expert Rust, C++, or Go skills, systems expertise, and experience with containers, virtualization, and networking.
GitLab
Bengaluru, India
Build and operate production backend features, APIs, integrations, and services for a large-scale DevSecOps platform. The role requires professional backend development experience, strong database and testing fundamentals, independent feature ownership, and clear asynchronous communication.
GitLab
United StatesBuild and maintain Ruby on Rails backend systems for GitLab’s vulnerability management workflows, including security dashboards, reports, and ingestion pipelines. The role requires backend application experience, PostgreSQL knowledge, technical problem-solving, and effective collaboration in a distributed team.
Cloudflare
Austin, TXSenior Software Engineer building and operating network infrastructure that carries traffic across critical paths of a global network. The role requires systems programming, Linux kernel networking and eBPF expertise, distributed-systems experience, and knowledge of BGP and Internet routing.