# Software Engineer, Distributed Systems

**Company:** [Fal](https://hotfix.jobs/companies/fal)
**Location:** San Francisco, CA
**Role:** Backend Engineering
**Salary:** $180k – $250k/yr
**Experience:** 5+ years
**Skills:** Python, Rust, Distributed Systems, Orchestration, Scheduling, Gpu Autoscaling, Observability, Consensus Algorithms, Fault Tolerance, Capacity Planning, Ai/Ml Infrastructure, High-Performance Systems Programming
**Posted:** 2025-07-21

> Build and scale fal's core Python/Rust distributed platform for AI workload orchestration, scheduling, GPU autoscaling, and low-latency global inference. Requires 3+ years building production distributed systems with deep knowledge of consensus, fault tolerance, and observability.

## Job Description

## Key Responsibilities
- Build our core Python/Rust platform: request routing, AI workload orchestration, scheduling, GPU autoscaling, large scale file storage, queueing, etc.
- Produce forward designs for platform evolution as we scale to 100x current traffic and need to provide low latency across the world.
- Leverage AI to an extreme level to automate the mundane parts of building complex but reliable systems.
- Profile and tune low level CPU and memory performance.

## Requirements
- 3+ years experience building distributed compute and orchestration platforms in Python or Rust.
- Strong understanding of distributed systems fundamentals: consensus, scheduling, fault tolerance, capacity planning.
- Deep understanding of computational complexity and memory allocation.
- Track record of designing systems that scale under real production load.
- Experience building and using observability to drive performance and reliability decisions.
- Excellent communication and ability to drive technical decisions across teams.
- Self-starter who executes quickly, takes ownership, and constantly seeks improvement.

## Nice-to-Haves
- Experience with AI/ML inference or training infrastructure.
- Experience with high-performance systems programming (async runtimes, zero-copy, memory-safe concurrency).
- Background in building multi-tenant compute platforms.
- Understanding of networking fundamentals and performance characteristics.
- Familiarity with GPU workload characteristics and scheduling constraints.

## Compensation
$180,000-250,000 plus equity + benefits (This range is across all 3 levels Mid, Senior and Staff).

## Similar roles

- [Backend Engineer](https://hotfix.jobs/jobs/8c0cdac6-4075-42b1-a874-6e856a68d2ba) - Fathom - AI Notetaker - Remote - $180k – $240k/yr
- [Software Engineer, Knowledge Systems](https://hotfix.jobs/jobs/afb75fbb-e379-420c-99a7-1eb6f7155291) - Exa - San Francisco, CA - $180k – $350k/yr
- [Software Engineer, Control Plane](https://hotfix.jobs/jobs/1f8d4743-d927-4daf-b738-f3122fe354d7) - Hightouch - Remote - $180k – $260k/yr
- [Software Engineer, Streaming Systems](https://hotfix.jobs/jobs/42426ad1-4ce5-451e-bd46-474088d85183) - Hightouch - Remote - $180k – $320k/yr
- [Software Engineer, Customer Studio Backend](https://hotfix.jobs/jobs/c1a85145-b4d5-46dd-9b35-e98f04a3d626) - Hightouch - Remote - $180k – $320k/yr

**Apply:** https://hotfix.jobs/jobs/e4f24df6-411f-450b-8f7e-c93b0b07dc58
**Canonical:** https://hotfix.jobs/jobs/e4f24df6-411f-450b-8f7e-c93b0b07dc58