Build and scale enterprise GenAI infrastructure across multi-cloud providers (AWS, Azure, GCP), implementing integrations and architecting systems for regulated industries. Requires 4+ years experience, proficiency in Python/JS/SQL, Kubernetes, and AI technologies like LLMs.
216k – 270k/yr
On-site4+ YOEDevOps / SRE
About the role
What You’ll Do
Architect multi-cloud systems and abstractions to allow the SGP platform to run on top of existing Cloud providers
Implement custom integrations between Scale AI's platform and customer data environments (cloud platforms, data warehouses, internal APIs)
Collaborate with platform, product teams and our customers directly to develop and implement innovative infrastructure that scales to meet evolving needs
Deliver experiments at a high velocity and level of quality to engage our customers
Work across the entire product lifecycle from conceptualization through production
Be able, and willing, to multi-task and learn new technologies quickly
What We’re Looking For
4+ years of full-time engineering experience, post-graduation
Experience scaling products at hyper growth startups
Experience tinkering with or productizing LLMs, vector databases, and the other latest AI technologies
Proficient in Python or Javascript/Typescript, and SQL
Experience with Kubernetes
Experience with major cloud providers (AWS, Azure, GCP)
Excellent communication skills with the ability to explain technical concepts to both technical and non-technical audiences
Owns and scales platform infrastructure including edge/cloud services on Cloudflare, GCP, Vercel and data layers like Spanner, ClickHouse, Postgres to serve millions of LLM requests daily. Requires 5+ years in production infrastructure with cloud platforms, databases, and full-stack TypeScript expertise.
215k – 285k/yr
Remote5+ YOEDevOps / SRE
HPC/ GPU Cluster Architect
SfcomputeSan Francisco, CA
Designs, architects, and scales production GPU/HPC clusters globally. Debugs hardware/software issues, automates operations, and mentors juniors. Requires 5+ years experience and hybrid SF presence.
220k – 300k/yr
Hybrid5+ YOEDevOps / SRE
Software Engineer, Platform
RillaNew York, NY
Builds and owns platform infrastructure from scratch including CI/CD, Terraform, AWS services, monitoring, SSO, and APIs for a scaling sales coaching startup. Requires deep experience in cloud infra, IaC, containers, databases, and observability.
220k – 300k/yr
On-siteDevOps / SRE
AI Infra Engineer
PerplexitySan Francisco, CA +1
Builds, deploys, and optimizes large-scale Kubernetes and Slurm clusters for AI training and inference. Requires 3+ years in ML infrastructure, expert Kubernetes/Slurm admin, Python/C++, and PyTorch experience.
220k – 405k/yr
On-site3+ YOEDevOps / SRE
Software Engineer, Delivery / CD
OpenAISan Francisco, CA +1
Builds and operates continuous deployment platforms for safe, rapid code rollouts across Kubernetes clusters and global regions. Focuses on progressive delivery, GitOps, automation, and AI-assisted workflows to boost developer productivity.