Skip to content

Backend Engineer - API

Build and own the xAI API and high-throughput inference infrastructure serving models globally with low latency and high availability. Requires expert Rust or C++ skills and experience with scalable distributed systems.

180k – 440kPalo Alto, CABackend EngineeringOnsite5+ YOE

About the role

Responsibilities

  • Build the xAI API that serves our models to developers worldwide
  • Own the end-to-end system responsible for high-throughput inference, handling billions of tokens per minute with low latency and high availability, including model serving infrastructure, request routing, SDK development, rate limiting, observability, and efficient scaling

Requirements

  • Expert knowledge of either Rust or C++
  • Experience in designing, implementing, and maintaining reliable and horizontally scalable distributed systems
  • Knowledge of service observability and reliability best practices
  • Experience in operating commonly used databases such as PostgreSQL, Clickhouse, and MongoDB

Preferred Skills

  • Experience with LLM inference engines and serving frameworks (e.g., SGLang, TensorRT, vLLM)
  • Experience designing or building with agent SDKs and agent orchestration frameworks
  • Experience with Docker, Kubernetes, and containerized applications
  • Expert knowledge of gRPC (unary, response streaming, bi-directional streaming, REST mapping)

Compensation and Benefits

  • $180,000 - $440,000 USD base salary
  • Equity
  • Comprehensive medical, vision, and dental coverage
  • Access to a 401(k) retirement plan
  • Short & long-term disability insurance
  • Life insurance
  • Various other discounts and perks

Skills

RustC++Distributed SystemsPostgresClickHouseMongoDBKubernetesDockergRPCvLLM

Software Engineer, Knowledge Systems

Build systems for extracting, connecting, retrieving, and reasoning over knowledge from the web to enable AI agents to answer questions with precision. Requires experience with complex distributed backend systems and petabyte-scale data pipelines.

180k – 350kSan Francisco, CABackend EngineeringOn-site5+ YOEData QualityData Pipelines

Software Engineer, Control Plane

Builds backend tools for enterprise control plane including access control, change management, and data warehouse optimization. Requires expertise in distributed systems, asynchronous workflows, and product-minded engineering for scalable, reliable architectures.

180k – 260kUnited StatesBackend EngineeringRemoteSnowflakeDatabricks

Software Engineer, Streaming Systems

Builds and scales high-throughput streaming infrastructure to ingest and process billions of customer behavioral events in real-time at sub-second latency. Owns end-to-end projects, solves customer scaling issues, and influences roadmap in a remote-first startup.

180k – 320kUnited StatesBackend EngineeringRemoteKafkaPulsar

Software Engineer, Customer Studio Backend

Builds backend systems for Customer Studio, optimizing data warehouse performance, real-time audience syncing, analytics, and AI-enhanced workflows for marketing teams. Requires strong distributed systems expertise and product-minded thinking.

180k – 320kUnited StatesBackend EngineeringRemoteSQLCdc

Billing & Analytics Software Engineer

Builds and maintains billing pipelines for usage metering, aggregation, invoicing, and integrations with platforms like M3ter and Salesforce. Delivers customer-facing dashboards and internal analytics, requiring 5+ years in SaaS billing systems and backend expertise in Python, TypeScript, or Go.

180k – 245kCaliforniaBackend EngineeringRemote5+ YOEGoSQS