# Software Engineer, ML Developer Experience

**Company:** [Anyscale](https://hotfix.jobs/companies/anyscale)
**Location:** San Francisco, CA
**Role:** Fullstack Engineering
**Salary:** $226k – $283k/yr
**Experience:** 5+ years
**Skills:** Ray, Python, PyTorch, MLflow, Data Catalogs, MLOps, OpenTelemetry, Openai Apis, Distributed Systems, System Design, Algorithms, Data Structures, Kubernetes, Cloud Infrastructure, Machine Learning Infrastructure
**Posted:** 2026-08-26

> Build developer-facing tooling, platform services, and ML infrastructure across Ray and Anyscale, spanning CLI, SDK, APIs, workspaces, observability, and production serving. Requires 5+ years of production software experience, strong systems fundamentals, and familiarity with machine learning tooling.

## Job Description

## Responsibilities
- Build developer tooling and MLOps capabilities on Ray for developers and coding agents.
- Develop CLI, SDK, API, and MCP surfaces with self-discovery, structured errors, dry-run support, and consistent platform behavior.
- Improve the path from local code to distributed execution across environments, dependencies, images, authentication, submission, and debugging.
- Build tools for data preparation, fine-tuning, post-training, evaluation, production serving, dataset management, experiment tracking, and lineage.
- Develop model registration, deployment workflows, performance benchmarking, and LLM service metrics.
- Provide observability across interfaces to diagnose failures across jobs, tasks, actors, nodes, and GPUs.
- Design integrations using OpenAI-compatible APIs, OpenTelemetry, and stable Jobs and Services interfaces.
- Design and operate highly available backend services and platform architecture across serverless and bring-your-own-cloud environments.
- Work with users, field teams, distributed systems experts, and machine learning experts to scope, ship, and iterate on products.

## Requirements
- Bachelor's degree in Computer Science, Engineering, or equivalent practical experience.
- 5+ years of experience writing high-quality production code.
- Strong foundation in algorithms, data structures, and system design.
- Experience with modern machine learning tooling such as PyTorch, MLflow, and data catalogs.
- Hands-on experience building and operating highly available production services.
- Strong product judgment and experience shipping developer-facing tools.

## Nice-to-haves
- Experience building and maintaining open-source projects.
- Experience building and operating machine learning infrastructure in production.
- Experience building and operating highly available serving systems.
- Experience using Ray.

## Similar jobs

- [Software Engineer, Product](https://hotfix.jobs/jobs/a23e8cc4-a9f5-45e4-be70-ba72530ad1a3) - Descript - Remote - $220k – $265k/yr
- [Forward Deployed Software Engineer, Cleared](https://hotfix.jobs/jobs/8e1cd82e-5190-48cc-83eb-5ef43d645572) - Kaizen Labs - Washington, DC - $220k – $280k/yr
- [Agent Experience Engineer](https://hotfix.jobs/jobs/10057d45-6710-4c73-9a6b-7d5602a67d5d) - Firecrawl - San Francisco, CA - $235k – $260k/yr
- [Open Source Engineer](https://hotfix.jobs/jobs/05a8c08e-01d1-495e-b3fc-e8edbaf68b8e) - Firecrawl - San Francisco, CA - $235k – $260k/yr
- [Product Engineer - Agent](https://hotfix.jobs/jobs/4f9cc1eb-a2e9-4005-86bc-2e74f5be5b00) - Firecrawl - San Francisco, CA - $235k – $260k/yr

**Apply:** https://hotfix.jobs/jobs/ae2f7473-d09a-4d7a-854d-f2cd4f6b0c1e
**Canonical:** https://hotfix.jobs/jobs/ae2f7473-d09a-4d7a-854d-f2cd4f6b0c1e