# Software Engineer, Platform Infrastructure

**Company:** [Anyscale](https://hotfix.jobs/companies/anyscale)
**Location:** Bengaluru, India
**Role:** Backend Engineering
**Experience:** 3+ years
**Skills:** Ray, Kubernetes, AWS, Azure, GCP, Go, Python, Prometheus, Grafana, Linux, Containers, Distributed Systems, Networking, Cloud Security, Gpus
**Posted:** 2026-07-31

> Builds and scales control-plane and data-plane infrastructure for distributed AI workloads, including Ray cluster orchestration, scheduling, Kubernetes deployments, and accelerator integration. Requires 3+ years of production software experience, distributed-systems expertise, and proficiency in Go and Python.

## Job Description

## Responsibilities
- Design, build, and scale services that orchestrate Ray clusters across cloud and on-premises environments, supporting VM-based and Kubernetes-based deployments.
- Optimize control-plane components for large-scale distributed AI/ML workloads.
- Build intelligent scheduling and resource-management systems for heterogeneous compute clusters.
- Develop features that improve the reliability, performance, scalability, and observability of managed Ray workloads.
- Support and optimize accelerator integration, including GPUs and TPUs.
- Handle container image management and dependency resolution for distributed workloads.
- Participate in code reviews and design and architecture discussions.
- Provide on-call support and collaborate with customer and field teams to troubleshoot infrastructure issues.
- Collaborate with distributed-systems and machine-learning experts to advance AI infrastructure.

## Requirements
- Bachelor's degree in Computer Science, Engineering, or equivalent practical experience.
- 3+ years of experience writing high-quality production code.
- Hands-on experience building and maintaining highly available, scalable, and performant distributed systems.
- Expertise in cloud-native technologies and Kubernetes-based deployments.
- Strong understanding of networking, security, and authentication mechanisms in cloud environments.
- Familiarity with observability stacks such as Prometheus and Grafana.
- Proficiency in Go and Python.
- Knowledge of low-level operating-system foundations, including the Linux kernel, file systems, and containers.

## Similar jobs

- [Software Engineer](https://hotfix.jobs/jobs/ed3ded4b-df9c-4dc1-87dd-3a954babe7f0) - Anyscale - San Francisco, CA - $215k – $265k/yr
- [Software Engineer - Wallets](https://hotfix.jobs/jobs/32955ac3-4c1c-4a94-83a2-7e6f18965180) - Rain - Remote - $220k – $270k/yr
- [Intermediate Backend Engineer](https://hotfix.jobs/jobs/25c8c189-ae7b-4774-9238-7be05b6c4b1b) - GitLab - Remote
- [Intermediate Backend Engineer](https://hotfix.jobs/jobs/8113217a-26e2-4d4b-86f1-55fa954ef043) - GitLab - Remote - $115k – $194k/yr
- [Software Engineer - Branching](https://hotfix.jobs/jobs/e74343fa-f4f1-4737-8d28-ddcadd6feb92) - Supabase - Remote

**Apply:** https://hotfix.jobs/jobs/16e81284-9188-48ac-9538-d6f8b6d86f70
**Canonical:** https://hotfix.jobs/jobs/16e81284-9188-48ac-9538-d6f8b6d86f70