Skip to content
OpenRouterOpenRouterUnited States

Software Engineer, Platform

Owns and scales platform infrastructure including edge/cloud services on Cloudflare, GCP, Vercel and data layers like Spanner, ClickHouse, Postgres to serve millions of LLM requests daily. Requires 5+ years in production infrastructure with cloud platforms, databases, and full-stack TypeScript expertise.

215k – 285k/yr
Remote5+ YOEDevOps / SRE

About the role

What You'll Do

  • Own and evolve our edge and cloud infrastructure across Cloudflare, Google Cloud, and Vercel.
  • Scale and operate our data layer including Spanner, ClickHouse, and Postgres.
  • Ensure we are optimizing for performance when serving LLM inference as traffic rapidly grows.
  • Partner with engineering leadership on capacity, reliability, and cost across the routing layer, with ownership of the systems carrying production traffic.
  • Set the bar and playbook for how we run infrastructure and operations as the team grows — tooling, observability, on-call, and the patterns other engineers build against.

About You

  • 5+ years building and operating production infrastructure at companies where uptime, latency, and cost matter.
  • Proven experience with cloud platforms (GCP, AWS, Azure) and edge-first serverless platforms (e.g. Cloudflare Workers).
  • Deep expertise in operating large scale databases (e.g Postgres, Spanner, etc).
  • A full-stack TypeScript shop won't faze you; you can move across the stack when the platform needs it.
  • High agency and a bias toward action. You don't wait for tickets — you see the bottleneck and fix it.
  • AI-forward in your workflow. You use coding agents, MCPs, and LLMs heavily and have opinions about what works.
  • Pragmatic about tradeoffs between speed and simplicity.

Bonus Points

  • Existing user of OpenRouter, or active side projects in AI products/infrastructure or developer tooling.

Compensation: Base salary $215,000 - $285,000 plus benefits & equity (US full-time). International compensation varies by local market.

Skills

GCPCloudflare WorkersSpannerClickHousePostgresTypeScriptAWSAzureLlm Inference

Similar roles

DevOps / SRE jobs
Scale AI

Infrastructure Software Engineer, Enterprise GenAI

Scale AISan Francisco, CA +2

Build and scale enterprise GenAI infrastructure across multi-cloud providers (AWS, Azure, GCP), implementing integrations and architecting systems for regulated industries. Requires 4+ years experience, proficiency in Python/JS/SQL, Kubernetes, and AI technologies like LLMs.

216k – 270k/yr
On-site4+ YOEDevOps / SRE
Sfcompute

HPC/ GPU Cluster Architect

SfcomputeSan Francisco, CA

Designs, architects, and scales production GPU/HPC clusters globally. Debugs hardware/software issues, automates operations, and mentors juniors. Requires 5+ years experience and hybrid SF presence.

220k – 300k/yr
Hybrid5+ YOEDevOps / SRE
Rilla

Software Engineer, Platform

RillaNew York, NY

Builds and owns platform infrastructure from scratch including CI/CD, Terraform, AWS services, monitoring, SSO, and APIs for a scaling sales coaching startup. Requires deep experience in cloud infra, IaC, containers, databases, and observability.

220k – 300k/yr
On-siteDevOps / SRE
OpenAI

Software Engineer, Delivery / CD

OpenAISan Francisco, CA +1

Builds and operates continuous deployment platforms for safe, rapid code rollouts across Kubernetes clusters and global regions. Focuses on progressive delivery, GitOps, automation, and AI-assisted workflows to boost developer productivity.

210k – 490k/yr
On-siteDevOps / SRE
Perplexity

AI Infra Engineer

PerplexitySan Francisco, CA +1

Builds, deploys, and optimizes large-scale Kubernetes and Slurm clusters for AI training and inference. Requires 3+ years in ML infrastructure, expert Kubernetes/Slurm admin, Python/C++, and PyTorch experience.

220k – 405k/yr
On-site3+ YOEDevOps / SRE