Skip to content
Scale AIScale AISan Francisco, CA

Infrastructure Software Engineer, Enterprise GenAI

Build and scale enterprise GenAI infrastructure across multi-cloud providers (AWS, Azure, GCP), implementing integrations and architecting systems for regulated industries. Requires 4+ years experience, proficiency in Python/JS/SQL, Kubernetes, and AI technologies like LLMs.

216k – 270k/yr
On-site4+ YOEDevOps / SRE

About the role

What You’ll Do

  • Architect multi-cloud systems and abstractions to allow the SGP platform to run on top of existing Cloud providers
  • Implement custom integrations between Scale AI's platform and customer data environments (cloud platforms, data warehouses, internal APIs)
  • Collaborate with platform, product teams and our customers directly to develop and implement innovative infrastructure that scales to meet evolving needs
  • Deliver experiments at a high velocity and level of quality to engage our customers
  • Work across the entire product lifecycle from conceptualization through production
  • Be able, and willing, to multi-task and learn new technologies quickly

What We’re Looking For

  • 4+ years of full-time engineering experience, post-graduation
  • Experience scaling products at hyper growth startups
  • Experience tinkering with or productizing LLMs, vector databases, and the other latest AI technologies
  • Proficient in Python or Javascript/Typescript, and SQL
  • Experience with Kubernetes
  • Experience with major cloud providers (AWS, Azure, GCP)
  • Excellent communication skills with the ability to explain technical concepts to both technical and non-technical audiences

Skills

PythonJavaScriptTypeScriptSQLKubernetesAWSAzureGCPLLMsVector Databases

Similar roles

DevOps / SRE jobs
OpenRouter

Software Engineer, Platform

OpenRouterUnited States

Owns and scales platform infrastructure including edge/cloud services on Cloudflare, GCP, Vercel and data layers like Spanner, ClickHouse, Postgres to serve millions of LLM requests daily. Requires 5+ years in production infrastructure with cloud platforms, databases, and full-stack TypeScript expertise.

215k – 285k/yr
Remote5+ YOEDevOps / SRE
Sfcompute

HPC/ GPU Cluster Architect

SfcomputeSan Francisco, CA

Designs, architects, and scales production GPU/HPC clusters globally. Debugs hardware/software issues, automates operations, and mentors juniors. Requires 5+ years experience and hybrid SF presence.

220k – 300k/yr
Hybrid5+ YOEDevOps / SRE
Rilla

Software Engineer, Platform

RillaNew York, NY

Builds and owns platform infrastructure from scratch including CI/CD, Terraform, AWS services, monitoring, SSO, and APIs for a scaling sales coaching startup. Requires deep experience in cloud infra, IaC, containers, databases, and observability.

220k – 300k/yr
On-siteDevOps / SRE
Perplexity

AI Infra Engineer

PerplexitySan Francisco, CA +1

Builds, deploys, and optimizes large-scale Kubernetes and Slurm clusters for AI training and inference. Requires 3+ years in ML infrastructure, expert Kubernetes/Slurm admin, Python/C++, and PyTorch experience.

220k – 405k/yr
On-site3+ YOEDevOps / SRE
OpenAI

Software Engineer, Delivery / CD

OpenAISan Francisco, CA +1

Builds and operates continuous deployment platforms for safe, rapid code rollouts across Kubernetes clusters and global regions. Focuses on progressive delivery, GitOps, automation, and AI-assisted workflows to boost developer productivity.

210k – 490k/yr
On-siteDevOps / SRE