# AI Infrastructure Engineer

**Company:** [Together AI](https://hotfix.jobs/companies/together-ai)
**Location:** San Francisco, CA
**Role:** DevOps / SRE
**Salary:** $190k – $270k/yr
**Experience:** 5+ years
**Skills:** Ansible, Terraform, Kubernetes, Pagerduty, Monitoring, Observability, Cloud Services, Distributed Systems, Linux, Networking
**Posted:** 2026-05-15

> Builds and maintains AI infrastructure using Ansible, Terraform, and Kubernetes, ensuring scalability, reliability, and high availability. Handles on-call incident response, monitoring, debugging, and infrastructure growth planning. Requires 5+ years experience and CS bachelor's.

## Job Description

## Responsibilities

- Participate in on-call rotation (Pagerduty) to respond to production incidents
- Build and run our infrastructure with Ansible, Terraform, and Kubernetes to enable scaling to a massive number of concurrent users
- Build monitoring systems to ensure the highest quality service for our customers
- Design and implement operational processes (such as deployments and upgrades)
- Debug production issues across all services and levels of the stack
- Identify improvements for the product architecture from the reliability, performance and availability perspectives
- Plan the growth of Together AI's infrastructure

## Requirements

- 5+ years of professional AI Infra or related experience
- Bachelor's degree in Computer Science or a related field or equivalent work experience
- Knowledge of Ansible (roles, playbooks), Terraform, and Kubernetes
- Proficiency in programming/scripting languages
- Direct experience in monitoring and observability practices
- Knowledge of cloud services
- Ability to thrive in a collaborative environment involving different stakeholders and subject matter experts

## Compensation

US base salary range: $190,000 - $270,000 + equity + benefits.

## Similar roles

- [Founding Software Engineer, Platform](https://hotfix.jobs/jobs/33f1133c-ddbf-4966-842f-5d7edad1868e) - GovWell - New York, NY - $190k – $260k/yr
- [Software Engineer (Infrastructure)](https://hotfix.jobs/jobs/b214faaa-9efc-4a35-910e-abc7a0a7d37b) - Centralize - Remote - $190k – $230k/yr
- [Site Reliability Engineer](https://hotfix.jobs/jobs/133e8f68-84e1-4c21-9ec2-d15ee4be2317) - Earnin - Mountain View, CA - $189k – $232k/yr
- [Software Engineer, Full-Stack — Developer Experience](https://hotfix.jobs/jobs/2ba8fa59-852f-425c-b375-4bcb7376fa66) - OpenAI - San Francisco, CA - $185k – $490k/yr
- [Platform Engineer](https://hotfix.jobs/jobs/17f04079-e8a6-4dfa-b43e-2e07947a49b6) - Eve - San Mateo, CA - $195k – $300k/yr

**Apply:** https://hotfix.jobs/jobs/4ceadbca-dec9-455c-9476-1cd10a0066a8
**Canonical:** https://hotfix.jobs/jobs/4ceadbca-dec9-455c-9476-1cd10a0066a8