# Site Reliability Engineer - AI Agents

**Company:** [Kraken](https://hotfix.jobs/companies/kraken)
**Location:** Remote
**Role:** DevOps / SRE
**Salary:** $96k – $192k/yr
**Experience:** 5+ years
**Skills:** Terraform, Kubernetes, Docker, AWS, Python, Bash, CI/CD, Observability, MLOps, Infrastructure As Code
**Posted:** 2026-06-11

> Design, build, and operate reliable infrastructure for AI agent workflows and model serving on AWS and Kubernetes. Build platform APIs, SDKs, and self-service tooling while ensuring observability and incident response for production AI systems.

## Job Description

## Responsibilities
- Design, build, and operate the infrastructure layer supporting AI agent workflows in production
- Ensure reliability, scalability, and observability of agentic systems across internal and external products
- Design and develop platform services, APIs, SDKs, and self-service capabilities that allow engineering teams to easily consume AI infrastructure and agent platform services
- Manage and maintain the compute, orchestration, and serving infrastructure powering model inference and agent execution
- Implement robust monitoring, alerting, and incident response procedures tailored to AI/ML workloads
- Utilize Infrastructure as Code (IaC) tools such as Terraform to provision and manage cloud (AWS) infrastructure components
- Build and maintain CI/CD pipelines that support rapid, reliable deployment of AI services and agent workflows
- Define and implement guardrails, failure handling, and recovery patterns specific to agentic and LLM-powered systems
- Collaborate with AI and Data Engineering teams to translate experimental agent prototypes into hardened production systems
- Manage containerized workloads using Kubernetes, ensuring efficient deployment, scaling, and orchestration of AI services
- Implement access controls and security best practices across AI infrastructure environments
- Document architecture, runbooks, and best practices to support knowledge sharing across the team

## Requirements
- 5+ years of experience as a Site Reliability Engineer, Infrastructure Engineer, Platform Engineer, or similar role in a production environment
- Hands-on experience supporting ML infrastructure, model serving, or MLOps workflows in production
- Experience building developer platforms, internal tooling, APIs, or SDKs consumed by engineering teams at scale
- Strong understanding of platform engineering principles, including developer experience, self-service infrastructure, and API-driven platform design
- Proficiency with Infrastructure as Code tools, particularly Terraform
- Experience with containerization and orchestration, particularly Kubernetes and Docker
- Solid understanding of cloud infrastructure, preferably AWS
- Strong scripting skills (bash/shell) and proficiency in at least one programming language (Python preferred)
- Experience designing and operating observability, monitoring, and alerting systems
- Experience implementing incident response procedures and participating in on-call rotations
- Strong collaboration skills working across data, AI, and engineering teams
- High ownership mindset in a fast-moving, high-stakes production environment

## Nice to Haves
- Experience building or operating infrastructure for agent-based or LLM-powered systems
- Familiarity with agent orchestration frameworks (e.g., LangGraph, CrewAI, or similar)
- Background in data infrastructure, including familiarity with Airflow, Kafka, Spark, or data lake tooling
- Experience with CI/CD pipelines and deployment automation for AI/ML workloads
- Exposure to evaluation frameworks and model performance monitoring at scale
- Experience working in fast-moving 0→1 environments or platform-building teams
- Experience building SDKs, developer tooling, or internal platform products with a strong focus on usability and adoption
- Experience with Cloudflare's cloud platform and product ecosystem, including networking, security, performance, and Zero Trust solutions

## Similar roles

- [Edge Engineer](https://hotfix.jobs/jobs/4175a8f5-900e-4b27-88a5-c7dbbf096b43) - Roboflow - Remote - $95k – $105k/yr
- [Software Engineer - Infrastructure](https://hotfix.jobs/jobs/476fc3c7-7a44-4d43-86af-f93805afad42) - Coram AI - Sunnyvale, CA - $100k – $180k/yr
- [Site Reliability Engineer](https://hotfix.jobs/jobs/e955cb93-2c0e-44fd-a3ba-a3259c9d86b2) - Astera - Emeryville, CA - $100k – $300k/yr
- [Site Reliability Engineer](https://hotfix.jobs/jobs/8c85ba01-c472-4c0f-ad3c-6ae174e67613) - Kalshi - New York, NY - $100k – $250k/yr
- [Infrastructure Engineer](https://hotfix.jobs/jobs/cf6b0a35-7eb0-4b35-bedc-be2cd5e14e30) - Kalshi - New York, NY - $100k – $250k/yr

**Apply:** https://hotfix.jobs/jobs/692fa8d9-8c72-498a-8fd3-e942c5938987
**Canonical:** https://hotfix.jobs/jobs/692fa8d9-8c72-498a-8fd3-e942c5938987