Skip to content
Together AITogether AISan Francisco, CA

AI Infrastructure Engineer

Builds and maintains AI infrastructure using Ansible, Terraform, and Kubernetes, ensuring scalability, reliability, and high availability. Handles on-call incident response, monitoring, debugging, and infrastructure growth planning. Requires 5+ years experience and CS bachelor's.

190k – 270k
On-site5+ YOEDevOps / SRE

About the role

Responsibilities

  • Participate in on-call rotation (Pagerduty) to respond to production incidents
  • Build and run our infrastructure with Ansible, Terraform, and Kubernetes to enable scaling to a massive number of concurrent users
  • Build monitoring systems to ensure the highest quality service for our customers
  • Design and implement operational processes (such as deployments and upgrades)
  • Debug production issues across all services and levels of the stack
  • Identify improvements for the product architecture from the reliability, performance and availability perspectives
  • Plan the growth of Together AI's infrastructure

Requirements

  • 5+ years of professional AI Infra or related experience
  • Bachelor's degree in Computer Science or a related field or equivalent work experience
  • Knowledge of Ansible (roles, playbooks), Terraform, and Kubernetes
  • Proficiency in programming/scripting languages
  • Direct experience in monitoring and observability practices
  • Knowledge of cloud services
  • Ability to thrive in a collaborative environment involving different stakeholders and subject matter experts

Compensation

US base salary range: $190,000 - $270,000 + equity + benefits.

Skills

AnsibleTerraformKubernetesPagerdutyMonitoringObservabilityCloud ServicesDistributed SystemsLinuxNetworking

Similar roles

DevOps / SRE jobs
GovWell

Founding Software Engineer, Platform

GovWellNew York, NY

Founding Platform Engineer responsible for building and operating core backend systems, including deployment, observability, incident response, and security foundations. Requires 5+ years experience with Node/TypeScript, AWS, Kubernetes, and strong ownership in a hybrid NYC role.

190k – 260k
Hybrid5+ YOEDevOps / SRE
Centralize

Software Engineer (Infrastructure)

CentralizeSan Francisco, CA +1

Owns backend infrastructure including Postgres, job queues, OpenSearch, Redis, and data pipelines at a fast-growing SaaS startup. Scales systems handling millions of events daily, focusing on reliability, tradeoffs, and production excellence. Requires deep scaling expertise in production systems.

190k – 230k
RemoteDevOps / SRE
Earnin

Site Reliability Engineer

EarninMountain View, CA

Site Reliability Engineer responsible for building resilient production systems, defining SLOs/SLIs, improving observability with Datadog/CloudWatch, leading incident response, automating toil reduction with AI tools, and collaborating with engineering teams on reliability practices. Requires 3+ years SRE/infra experience, coding in Python/Go, and distributed systems knowledge.

189k – 232k
Hybrid3+ YOEDevOps / SRE
OpenAI

Software Engineer, Full-Stack — Developer Experience

OpenAISan Francisco, CA +2

Build and operate scalable CI and Bazel-based build systems that accelerate engineering velocity and reliability for OpenAI's products and infrastructure.

185k – 490k
On-site5+ YOEDevOps / SRE
Eve

Platform Engineer

EveSan Mateo, CA

Build scalable infrastructure and data pipelines for AI/ML applications in legal tech. Collaborate with ML and dev teams to optimize performance and enhance developer productivity; requires cloud expertise and bachelor's/master's in CS.

195k – 300k
HybridDevOps / SRE