Skip to content
SpellbrushSpellbrushSan Francisco, CA

AI Infrastructure Engineer

Builds and runs end-to-end ML inference infrastructure for generative AI image models across mobile and web platforms. Requires expertise in distributed systems, Kubernetes, Kafka, Redis, GPUs, and multi-cloud environments.

Salary not listed
On-siteDevOps / SRE

About the role

Responsibilities

  • Design, implement and run next-generation inference architecture for running models powering all platforms and applications (mobile, web, etc.).
  • Work alongside fast-paced team developing state-of-the-art image generation models serving over 16 million users.

Requirements

  • Experience with large distributed systems.
  • Familiarity with K8S, Kafka, NATS, Redis, etc.
  • Experience with on-prem and multi-cloud clusters.
  • Deep understanding of tradeoffs and failure modes of systems.
  • Excellent understanding of GPUs handling large workloads.
  • Experience deploying or optimizing GPU workloads end-to-end is a huge plus.
  • Comfortable working on small, fast-paced teams.

Nice-to-Haves

  • Passion for anime aesthetic.

Skills

KubernetesKafkaNatsRedisGPUDistributed SystemsMulti-CloudInference Architecture

Similar roles

DevOps / SRE jobs
Forus

Software Engineer, Platform & Infrastructure

ForusNew York, NY

Software Engineer owning Forus' compute platform (EKS/Kubernetes), data layer (Postgres, OpenSearch, BigQuery), cloud cost optimization, reliability (SLOs, observability), and IaC primitives in a regulated healthcare environment. Requires production Kubernetes at scale, deep AWS/Terraform expertise, and database migration experience.

Salary not listed
On-site5+ YOEDevOps / SRE
Forus

Software Engineer, Developer Productivity

ForusNew York, NY

Software Engineer owning CI/CD, build systems, and infrastructure for AI coding agents to accelerate the entire engineering organization's velocity at an AI-powered healthcare network company. Requires strong infrastructure instincts, Python/Bash expertise, and experience driving developer productivity and adoption of agentic workflows.

Salary not listed
On-siteDevOps / SRE
Runloop

Site Reliability Engineer

RunloopSan Francisco, CA

Site Reliability Engineer responsible for the reliability, observability, performance, and security of a core AI agent platform including code sandboxes. Requires 5+ years software engineering experience (3+ in SRE/DevOps), strong CS fundamentals, expertise in containers, cloud IaC, monitoring, and distributed systems.

Salary not listed
On-site5+ YOEDevOps / SRE
Applied Intuition

Build & Release Engineer

Applied IntuitionSunnyvale, CA

Build and maintain CI/CD pipelines, own end-to-end software releases and artifact management with Artifactory, and develop the internal Release Management portal as a hands-on software engineer. Requires 3+ years software development experience and strong CI/CD and Git expertise.

118k – 200k/yr
On-site3+ YOEDevOps / SRE
Lyft

Software Engineer, Async Platform

LyftSeattle, WA

Software engineer building and maintaining a highly scalable asynchronous platform at Lyft. Design, develop and operate tooling for reliability, scalability and efficiency of distributed systems and infrastructure. Requires 5+ years in software development, automation and systems engineering with experience in Go/Python and cloud platforms.

118k – 147k/yr
Hybrid5+ YOEDevOps / SRE