# Staff Software Engineer

**Company:** [Alluxio](https://hotfix.jobs/companies/alluxio)
**Location:** Foster City, CA
**Role:** Backend Engineering
**Skills:** Java, C++, Go, Kubernetes, Spark, Presto, Hadoop, S3, Gcs, Hdfs
**Posted:** 2024-05-21

> Staff Software Engineer designs and implements core components of Alluxio's distributed data orchestration platform, optimizing caching, metadata, and I/O for large-scale AI/ML workloads across multi-cloud environments. Requires strong distributed systems expertise in Java/C++/Go and technical leadership.

## Job Description

## What You’ll Own
- **Cache and metadata consistency** - advance Alluxio’s intelligent caching framework for multi-tenant environments (TTL policies, write-back consistency, invalidation protocols, and distributed metadata scaling).
- **High-throughput data I/O optimization** - profile and optimize Alluxio’s data path across S3, GCS, HDFS, and POSIX interfaces using adaptive prefetching, async I/O, and tier-aware scheduling.
- **Scaling for AI and analytics workloads** - evolve the coordination layer to efficiently serve distributed AI training clusters, accelerating model load and shuffle operations across regions and clouds.
- **Observability and performance insights** - build fine-grained metrics and tracing for cache efficiency, throughput, and latency across storage tiers.
- **Open-source leadership** - drive design discussions, mentor contributors, and represent Alluxio’s core-systems direction within the OSS community.

## What You’ll Do
- Design and implement core components of Alluxio’s distributed file and object-access layer.
- Optimize performance for large-scale, high-throughput environments using advanced concurrency and caching techniques.
- Build scalable metadata and coordination systems that ensure strong consistency, high availability, and minimal latency.
- Collaborate cross-functionally with product, solution-engineering, and research teams to drive roadmap and customer success.

## What We’re Looking For
- Strong computer-science fundamentals and a passion for large-scale distributed systems.
- Professional experience developing in **Java**, **C++**, or **Go**.
- Deep understanding of concurrency, replication, fault tolerance, and performance optimization.
- Experience with distributed storage, data-access layers, or cloud infrastructure (e.g., **Spark**, **Presto**, **Hadoop**, **Kubernetes**).
- Bachelor’s or advanced degree in Computer Science or related technical field (or equivalent experience).
- Demonstrated technical leadership: defining architecture, mentoring peers, or driving major projects from design through release.

## Similar roles

- [Staff Software Engineer, Backend](https://hotfix.jobs/jobs/807748ff-c0bb-45b6-8d08-95df45fd7a54) - Rippling - San Francisco, CA - $189k – $315k/yr
- [Staff Backend Engineer](https://hotfix.jobs/jobs/b356996c-9ea9-4c66-8774-0cf5944dad09) - Aurelian - Seattle, WA - $200k – $300k/yr
- [Staff Backend Engineer, Identity Threat Protection](https://hotfix.jobs/jobs/f26dd822-f888-4c9a-8336-09762587d7cc) - Okta - San Francisco, CA - $194k – $267k/yr
- [Staff Software Engineer, Platform](https://hotfix.jobs/jobs/b2d42759-cf0d-4deb-ac34-f042721e13b6) - Zus Health - Remote - $170k – $200k/yr
- [Senior Staff Software Engineer, Payments](https://hotfix.jobs/jobs/be4bb7e7-7e74-474b-8f37-260b2a1cb607) - Coinbase - Remote - $254k – $299k/yr

**Apply:** https://hotfix.jobs/jobs/02eae4ec-aaaf-4746-8852-556a6f9ac08e
**Canonical:** https://hotfix.jobs/jobs/02eae4ec-aaaf-4746-8852-556a6f9ac08e