Skip to content
FalFalSan Francisco, CA

Software Engineer, Distributed Systems

Build and scale fal's core Python/Rust distributed platform for AI workload orchestration, scheduling, GPU autoscaling, and low-latency global inference. Requires 3+ years building production distributed systems with deep knowledge of consensus, fault tolerance, and observability.

180k – 250k/yr
Hybrid5+ YOEBackend Engineering

About the role

Key Responsibilities

  • Build our core Python/Rust platform: request routing, AI workload orchestration, scheduling, GPU autoscaling, large scale file storage, queueing, etc.
  • Produce forward designs for platform evolution as we scale to 100x current traffic and need to provide low latency across the world.
  • Leverage AI to an extreme level to automate the mundane parts of building complex but reliable systems.
  • Profile and tune low level CPU and memory performance.

Requirements

  • 3+ years experience building distributed compute and orchestration platforms in Python or Rust.
  • Strong understanding of distributed systems fundamentals: consensus, scheduling, fault tolerance, capacity planning.
  • Deep understanding of computational complexity and memory allocation.
  • Track record of designing systems that scale under real production load.
  • Experience building and using observability to drive performance and reliability decisions.
  • Excellent communication and ability to drive technical decisions across teams.
  • Self-starter who executes quickly, takes ownership, and constantly seeks improvement.

Nice-to-Haves

  • Experience with AI/ML inference or training infrastructure.
  • Experience with high-performance systems programming (async runtimes, zero-copy, memory-safe concurrency).
  • Background in building multi-tenant compute platforms.
  • Understanding of networking fundamentals and performance characteristics.
  • Familiarity with GPU workload characteristics and scheduling constraints.

Compensation

$180,000-250,000 plus equity + benefits (This range is across all 3 levels Mid, Senior and Staff).

Skills

PythonRustDistributed SystemsOrchestrationSchedulingGpu AutoscalingObservabilityConsensus AlgorithmsFault ToleranceCapacity PlanningAi/Ml InfrastructureHigh-Performance Systems Programming
Fathom - AI Notetaker

Backend Engineer

Fathom - AI NotetakerUnited States

Backend Engineer building and scaling highly-available services for Fathom's AI meeting assistant. Requires strong Rails and Kubernetes/Go experience to improve reliability, efficiency, and customer experience at massive scale.

180k – 240k/yr
Remote5+ YOEBackend Engineering
Exa

Software Engineer, Knowledge Systems

ExaSan Francisco, CA

Build systems for extracting, connecting, retrieving, and reasoning over knowledge from the web to enable AI agents to answer questions with precision. Requires experience with complex distributed backend systems and petabyte-scale data pipelines.

180k – 350k/yr
On-site5+ YOEBackend Engineering
Hightouch

Software Engineer, Control Plane

HightouchUnited States

Builds backend tools for enterprise control plane including access control, change management, and data warehouse optimization. Requires expertise in distributed systems, asynchronous workflows, and product-minded engineering for scalable, reliable architectures.

180k – 260k/yr
RemoteBackend Engineering
Hightouch

Software Engineer, Streaming Systems

HightouchUnited States

Builds and scales high-throughput streaming infrastructure to ingest and process billions of customer behavioral events in real-time at sub-second latency. Owns end-to-end projects, solves customer scaling issues, and influences roadmap in a remote-first startup.

180k – 320k/yr
RemoteBackend Engineering
Hightouch

Software Engineer, Customer Studio Backend

HightouchUnited States

Builds backend systems for Customer Studio, optimizing data warehouse performance, real-time audience syncing, analytics, and AI-enhanced workflows for marketing teams. Requires strong distributed systems expertise and product-minded thinking.

180k – 320k/yr
RemoteBackend Engineering