# Senior Software Engineer, ML Infrastructure

**Company:** [Arena](https://hotfix.jobs/companies/arena)
**Location:** San Francisco, CA
**Role:** ML Engineering
**Experience:** 5+ years
**Skills:** Distributed Systems, Stream Processing, Scalable Backend, Low-Latency Systems, High-Throughput Systems, Fault-Tolerant Systems, System Design, Performance Tuning, PyTorch, ML Infrastructure
**Posted:** 2025-12-18

> Leads design and development of scalable, real-time API and data infrastructure for AI model evaluations, processing large-scale event streams with low latency. Requires 5+ years in infrastructure or ML systems, expertise in distributed systems, stream processing, and backend architecture.

## Job Description

## Responsibilities

- Architect and scale high-performance, real-time API and data systems
- Design and implement low-latency pipelines to process and analyze large-scale event streams
- Ensure reliability through robust data integrity, availability, and consistency mechanisms
- Mentor and guide engineers on infrastructure best practices, architecture, and performance tuning
- Collaborate cross-functionally with AI researchers, product leaders, and engineers to anticipate evolving infrastructure needs and deliver resilient, extensible systems

## Requirements

- 5+ years of experience in software engineering, with a focus on infrastructure or large-scale data and ML systems
- Deep expertise in distributed systems, stream processing, and scalable backend architecture
- Proven ability to design and operate low-latency, high-throughput, and fault-tolerant systems
- Strong foundation in systems design, performance tuning, and building reliable, fault-tolerant services
- Comfortable in a dynamic, high-ownership, fast-growth environment

## Nice-to-haves

- Prior experience with PyTorch model development

## Similar roles

- [Senior Machine Learning Engineer, Agent Oversight](https://hotfix.jobs/jobs/1f504a69-044f-47ab-872b-120a1706cd88) - Scale AI - San Francisco, CA - $216k – $270k/yr
- [Senior Software Engineer, Agent Oversight](https://hotfix.jobs/jobs/808ce719-6b16-4b6e-8887-8c8f8a780b75) - Scale AI - San Francisco, CA - $216k – $270k/yr
- [Senior Software Engineer, AI Infrastructure](https://hotfix.jobs/jobs/dd1c3420-6c0a-47ed-a1a7-de401bdf506c) - Ambient.ai - Redwood City, CA - $168k – $205k/yr
- [Senior Software Engineer](https://hotfix.jobs/jobs/423c60aa-ca4c-400d-babe-a50099433cbb) - SpotOn - Chicago, IL - $160k – $190k/yr
- [Senior AI Engineer, Enterprise](https://hotfix.jobs/jobs/87a30fd1-3fe6-47f3-a0a1-da444f3c00f4) - Snowflake - Menlo Park, CA - $156k – $224k/yr

**Apply:** https://hotfix.jobs/jobs/98d2710e-b3e6-4dc3-a030-7d41dc684752
**Canonical:** https://hotfix.jobs/jobs/98d2710e-b3e6-4dc3-a030-7d41dc684752