Skip to content
Fal

Software Engineer, Compute (Mid/Senior/Staff)

Builds large-scale distributed compute platforms in Python/Rust for AI workloads, including orchestration, GPU autoscaling, and low-latency global scaling. Requires 3+ years in distributed systems with strong fundamentals in consensus, fault tolerance, and performance tuning.

180k – 250kSan Francisco, CABackend EngineeringHybrid
Apply

About the role

Key Responsibilities

  • Build our core Python/Rust platform: request routing, AI workload orchestration, scheduling, GPU autoscaling, large scale file storage, queueing, etc
  • Produce forward designs for platform evolution as we scale to 100x current traffic and need to provide low latency across the world
  • Leverage AI to an extreme level to automate the mundane parts of building complex but reliable systems
  • Profile and tune low level CPU and memory performance

Requirements

  • 3+ years experience building distributed compute and orchestration platforms in Python or Rust
  • Strong understanding of distributed systems fundamentals: consensus, scheduling, fault tolerance, capacity planning
  • Deep understanding of computational complexity and memory allocation
  • Track record of designing systems that scale under real production load
  • Experience building and using observability to drive performance and reliability decisions
  • Excellent communication and ability to drive technical decisions across teams
  • Self-starter who executes quickly, takes ownership, and constantly seeks improvement

Nice to Have

  • Experience with AI/ML inference or training infrastructure
  • Experience with high-performance systems programming (async runtimes, zero-copy, memory-safe concurrency)
  • Background in building multi-tenant compute platforms
  • Understanding of networking fundamentals and performance characteristics
  • Familiarity with GPU workload characteristics and scheduling constraints

Compensation

$180,000-250,000 plus equity + benefits (This range is across all 3 levels)

Skills

PythonRustDistributed SystemsKubernetesGPUObservabilityAI/MLAsync RustNetworkingScheduling

Similar roles

Backend Engineering jobs
Skylight

Senior or Staff Back End Engineer, AI Features

Seasoned backend engineer building AI-powered features in Ruby on Rails, integrating with LLMs (OpenAI, Google, Anthropic) and owning zero-to-one product initiatives. Requires 6+ years experience shipping products end-to-end.

180k – 240kUnited StatesBackend EngineeringRemote6+ YOERAGOpenAI
xAI

Member of Technical Staff

Write and maintain production backend services, build scalable frameworks, and deploy infrastructure using Java, Python, React, Docker, and Kubernetes. Requires 1 year of experience with LLMs, recommendation systems, and probabilistic modeling.

180k – 220kPalo Alto, CABackend EngineeringOn-site1+ YOEJavaLLMs
Stellar Cyber

Senior Staff Software Engineer - Integration

Senior Staff Software Engineer owning integration domains end-to-end for an AI-driven cybersecurity SecOps platform. Architects microservices, designs APIs, mentors engineers, and leverages AI tools to accelerate development.

180k – 245kUnited StatesBackend EngineeringRemote8+ YOEGoAWS
Vapi

Member of Technical Staff, Core Backend

Owns the StreamModule voice pipeline (VAD→STT→LLM→TTS) for real-time call agents. Consolidates BullMQ to Kafka, hardens provider abstractions, adds OTEL tracing, and eliminates Postgres SPOFs.

180k – 265kSan Francisco, CABackend EngineeringHybrid5+ YOEKafkaNestjs
Aurelian

Staff Backend Engineer

Staff Backend Engineer to architect and scale voice AI systems for 911 centers, optimizing realtime pipelines and integrating with customer systems. Requires 6+ years of experience and strong engineering fundamentals.

180k – 240kSeattle, WABackend EngineeringOn-site6+ YOEGoSQL