# Staff Infrastructure Software Engineer, Enterprise AI

**Company:** [Scale AI](https://hotfix.jobs/companies/scale-ai)
**Location:** New York, NY, San Francisco, CA
**Role:** DevOps / SRE
**Salary:** $216k – $270k/yr
**Experience:** 5+ years
**Skills:** Kubernetes, Terraform, Helm, Datadog, Prometheus, Grafana, AWS, Azure, GCP, Python
**Posted:** 2026-02-12

> Builds and scales multi-cloud infrastructure for enterprise AI Agentic workflows, focusing on security, compliance, observability, and developer tools. Requires 5+ years experience with modern infra practices, cloud providers, and languages like Python.

## Job Description

## What You'll Do:
- **Define the architectural patterns** for our multi-cloud infrastructure to support secure, reliable, and scalable Agentic workflows for enterprise customers.
- **Lead the infrastructure roadmap** with a strong focus on compliance, privacy, and security standards, including designing change management and data isolation strategies.
- **Own the development and maintenance** of our best-in-class Agentic observability platform (logging, metrics, tracing, and analytics) to proactively ensure system health and enable rapid incident response.
- **Drive developer efficiency** by building automated tooling and championing Infrastructure-as-Code (IaC) paradigms throughout the engineering organization.
- **Solve the toughest engineering problems** related to multi-tenancy, data isolation, and high-performance inference at a massive scale, taking end-to-end ownership across the full product lifecycle.

## What We're Looking For:
- **Proven experience** in a senior role, with **5+ years** of full-time software engineering experience.
- **Deep understanding of modern infrastructure practices**, including CI/CD, IaC (e.g., Terraform, Helm Charts), container orchestration (e.g., Kubernetes) and observability platforms (e.g., Datadog, Prometheus, Grafana).
- **Extensive experience with at least one major cloud provider** (AWS, Azure, or GCP).
- **Strong knowledge of security and compliance** in enterprise environments, with a focus on access management, data isolation, and customer-specific VPC setups.
- **Proficiency in Python or JavaScript/TypeScript, and SQL**.
- **Bonus points**: Hands-on experience and a passion for working with Agents, LLMs, vector databases, and other emerging AI technologies.

## Similar roles

- [Staff Software Engineer, Cloud Monitoring Service](https://hotfix.jobs/jobs/aba5b9e6-8f41-42ff-bd54-2101b65e114d) - Crusoe - San Francisco, CA - $215k – $260k/yr
- [Staff Software Engineer, Network Automation](https://hotfix.jobs/jobs/c9c70fbd-435a-4746-8c14-153fecccddbc) - Crusoe - San Francisco, CA - $215k – $260k/yr
- [Staff Software Engineer, Platform Infrastructure](https://hotfix.jobs/jobs/956d11b9-6273-4a1c-92ad-1363e016dba6) - Astronomer - New York, NY - $215k – $250k/yr
- [Staff Site Reliability Engineer](https://hotfix.jobs/jobs/7a41fe97-c11d-474e-9f6a-dd506d1f3fa4) - Idme - Mountain View, CA - $218k – $260k/yr
- [Staff Software Engineer, Core Reliability](https://hotfix.jobs/jobs/e23f6926-088d-4866-8936-1b35330e5252) - Coinbase - Remote - $218k – $257k/yr

**Apply:** https://hotfix.jobs/jobs/223e9053-6d4a-46f8-8f3a-badb573e6569
**Canonical:** https://hotfix.jobs/jobs/223e9053-6d4a-46f8-8f3a-badb573e6569