Senior Software Engineer
Senior Software Engineer designs and optimizes distributed systems for Alluxio's data orchestration platform, focusing on caching, metadata management, I/O performance, and fault-tolerance in multi-cloud environments. Requires strong experience in Java/C++/Go and distributed storage technologies like Spark, Hadoop, and Kubernetes.
About the job
What You’ll Own
- Cache and metadata enhancements - design and implement improvements to caching policies, eviction logic, and metadata scalability to increase performance and reliability.
- Data path optimization - refine I/O pipelines for S3/GCS/HDFS/Posix to reduce latency and improve throughput using concurrency and scheduling techniques.
- Distributed systems reliability - strengthen consistency, replication, and fault-tolerance mechanisms across large-scale clusters.
- Feature development and integration - collaborate with product and solution-engineering teams to deliver features that support AI and analytics workloads.
- Code quality and peer collaboration - participate in design reviews, provide constructive feedback, and ensure robust testing and observability in production systems.
What You’ll Do
- Design, build, and optimize distributed components within Alluxio’s orchestration layer.
- Investigate performance bottlenecks and propose scalable solutions using profiling, tracing, and benchmarking tools.
- Collaborate cross-functionally with fellow engineers, architects, and the open-source community to drive improvements.
- Contribute to releases and stability efforts, ensuring enterprise-grade reliability across global deployments.
What We’re Looking For
- Strong computer-science fundamentals and a passion for large-scale distributed systems.
- Professional experience developing in Java, C++, or Go.
- Practical knowledge of concurrency, replication, distributed coordination, and performance tuning.
- Experience with distributed storage, caching, or data-access layers (e.g., Spark, Presto, Hadoop, Kubernetes).
- Bachelor’s or advanced degree in Computer Science or related technical field (or equivalent experience).
Skills
Java, C++, Go, Kubernetes, Hadoop, Spark, Presto, S3, Gcs, Hdfs
Similar jobs
Backend Engineering jobs
Coinbase
United States
Build and operate high-throughput blockchain infrastructure, APIs, and platform primitives integrating protocols such as Ethereum and Bitcoin with internal services. Requires 5+ years of software engineering experience, distributed-systems expertise, and hands-on crypto infrastructure experience.
Cloudflare
Atlanta, GADesign, build, and operate Cloudflare’s globally distributed cache and reverse-proxy data plane, improving performance, correctness, and resilience across the edge. Requires at least 4 years of production systems experience and proficiency in a systems or backend language.
Hinge Health
San Francisco, CA
Senior backend engineer designing and operating reliable billing and financial systems, APIs, data models, and distributed workflows. The role requires 5+ years of professional software development experience, strong backend expertise, and collaboration across Product, Finance, Operations, and Data.
CommandLink
United StatesSenior individual contributor responsible for designing, building, operating, and improving large-scale backend services, APIs, and telemetry pipelines in Go and Python. The role requires production systems ownership, distributed-systems expertise, incident leadership, mentoring, and technical design leadership.
Fetch
United States
Build and operate backend services, data pipelines, storage, and retrieval systems that provide trusted context to agentic platforms and product applications. The role requires 8+ years of software engineering experience, distributed-systems expertise, cloud infrastructure knowledge, and strong data modeling skills.