# Infrastructure Software Engineer, Enterprise GenAI

**Company:** [Scale AI](https://hotfix.jobs/companies/scale-ai)
**Location:** San Francisco, CA, New York, NY, Seattle, WA
**Role:** DevOps / SRE
**Salary:** $216k – $270k/yr
**Experience:** 4+ years
**Skills:** Python, JavaScript, TypeScript, SQL, Kubernetes, AWS, Azure, GCP, LLMs, Vector Databases
**Posted:** 2026-02-24

> Build and scale enterprise GenAI infrastructure across multi-cloud providers (AWS, Azure, GCP), implementing integrations and architecting systems for regulated industries. Requires 4+ years experience, proficiency in Python/JS/SQL, Kubernetes, and AI technologies like LLMs.

## Job Description

## What You’ll Do
- Architect multi-cloud systems and abstractions to allow the SGP platform to run on top of existing Cloud providers
- Implement custom integrations between Scale AI's platform and customer data environments (cloud platforms, data warehouses, internal APIs)
- Collaborate with platform, product teams and our customers directly to develop and implement innovative infrastructure that scales to meet evolving needs
- Deliver experiments at a high velocity and level of quality to engage our customers
- Work across the entire product lifecycle from conceptualization through production
- Be able, and willing, to multi-task and learn new technologies quickly

## What We’re Looking For
- **4+ years** of full-time engineering experience, post-graduation
- Experience scaling products at hyper growth startups
- Experience tinkering with or productizing **LLMs**, **vector databases**, and the other latest AI technologies
- Proficient in **Python** or **Javascript/Typescript**, and **SQL**
- Experience with **Kubernetes**
- Experience with major cloud providers (**AWS**, **Azure**, **GCP**)
- Excellent communication skills with the ability to explain technical concepts to both technical and non-technical audiences

## Similar roles

- [Software Engineer, Platform](https://hotfix.jobs/jobs/51685599-f56d-4a75-8ff2-c21639917f1d) - OpenRouter - Remote - $215k – $285k/yr
- [HPC/ GPU Cluster Architect](https://hotfix.jobs/jobs/357dc6b1-3fc0-4c6b-9168-bd1081710761) - Sfcompute - San Francisco, CA - $220k – $300k/yr
- [Software Engineer, Platform](https://hotfix.jobs/jobs/0d87e492-9b64-4197-a80d-d7f13cd1d874) - Rilla - New York, NY - $220k – $300k/yr
- [AI Infra Engineer](https://hotfix.jobs/jobs/e8b47a29-b977-44af-827e-10077c17d288) - Perplexity - San Francisco, CA - $220k – $405k/yr
- [Software Engineer, Delivery / CD](https://hotfix.jobs/jobs/187d0ae4-8435-4cac-a1b6-6259aeb7c077) - OpenAI - San Francisco, CA - $210k – $490k/yr

**Apply:** https://hotfix.jobs/jobs/af9b85df-b6ee-4cb2-bc78-6d25f9a45cb6
**Canonical:** https://hotfix.jobs/jobs/af9b85df-b6ee-4cb2-bc78-6d25f9a45cb6