Skip to content

Anyscale

Scalable compute platform for AI built on Ray

aiSan Francisco, CA201-1000Series COnsiteFounded 2019
About

Anyscale provides a fully-managed platform based on the open-source Ray framework for developers to build, scale, and run distributed AI and ML applications from laptops to cloud clusters. It serves AI teams at companies like OpenAI, Uber, and Amazon, eliminating infrastructure management to focus on innovation. This enables effortless scaling of AI workloads critical for production AI.

Tech stack
GCPRayTensorFlowAzureCommunity BuildingSplunkPrometheusSecurity ModelsGrafanaAWSKubernetesTerraformPythonGoGitHub ActionsC++GPU programmingLinuxPyTorchvLLM
Perks & benefits
Health insuranceDental insuranceVision insuranceFertility benefitsPaid parental leaveFlexible PTOLearning stipendWellness stipendIn-office mealsCommute reimbursementMental health support
Open roles 7

Forward Deployed Engineer

Partner directly with strategic customers to drive Ray and Anyscale platform adoption through onsite proof-of-value engagements, technical solution delivery, and enterprise enablement.

267k – 287kSan Francisco, CASolutions ArchitectureOn-site5+ YOERaySaaS

Senior Site Reliability Engineer, Platform Infrastructure

Senior SRE building and scaling control and data plane infrastructure for distributed AI/ML workloads on Ray. Requires 3+ years production experience, strong distributed systems background, Kubernetes, cloud platforms, Go/Python, and observability expertise.

San Francisco, CA +2DevOps / SREHybrid3+ YOEGoAWS

Technical Program Manager

Lead complex application development programs for Anyscale's ML/AI product platform. Collaborate with engineering and product teams to plan, execute, and deliver scalable commercial products while managing risks, schedules, and stakeholder alignment.

San Francisco, CATechnical Program ManagementOn-site5+ YOESchedulingCloud Platforms

Customer Engineer

The Customer Engineer will help customers onboard, adopt, and grow on the Anyscale platform, troubleshooting and resolving technical issues. This role involves close coordination with engineering teams to debug complex issues and contribute to product improvement.

San Francisco, CA +1Support EngineeringOn-site3+ YOEAWSGCP

Distributed LLM Inference Engineer

Build and optimize distributed LLM inference systems at scale using Ray, integrating with engines like vLLM to deliver high-throughput, low-latency batch and online inference solutions.

170k – 247kSan Francisco, CA +2ML EngineeringHybridRayTvm

Software Engineer (Ray Core)

Develop and optimize Ray Core C++ backend for scalable distributed applications, focusing on performance, reliability, fault tolerance, and testing. Requires 5+ years experience in C/C++, distributed systems, algorithms, and systems programming.

San Francisco, CA +2Backend EngineeringHybrid5+ YOEC++Algorithms

Senior / Staff Product Manager - Ray Data

Leads product roadmap for Ray Data, balancing open source growth with commercial features for Anyscale Runtime. Requires 4+ years PM experience, strong technical background in distributed systems/ML infrastructure, and strategic thinking for ML/data lifecycle.

219k – 250kSan Francisco, CA +2Product ManagementOn-site4+ YOERay DataMl Tooling