Skip to content
RillaRillaNew York, NY

Software Engineer, Platform

Builds and owns platform infrastructure from scratch including CI/CD, Terraform, AWS services, monitoring, SSO, and APIs for a scaling sales coaching startup. Requires deep experience in cloud infra, IaC, containers, databases, and observability.

220k – 300k/yr
On-siteDevOps / SRE

About the role

Responsibilities

  • Build, ship, monitor, and scale infrastructure including CI/CD pipelines, Terraform modules, monitoring stack, SSO integrations, and API infrastructure.
  • Write code, design systems, make architectural decisions, and own end-to-end from idea to production.
  • Serve Rilla's customers and engineers as internal customers.

Requirements

  • Cloud infrastructure experience (AWS: ECS, RDS, VPC, IAM, S3, CloudWatch).
  • Terraform or similar IaC tools.
  • CI/CD pipelines for infrastructure and application deployment.
  • Containerization (Docker, ECS or Kubernetes).
  • Database administration (PostgreSQL: optimization, indexing, backup/recovery, monitoring).
  • RESTful API design for external customers.
  • Authentication protocols (OAuth 2.0, SAML, OIDC for SSO).
  • Monitoring/observability (CloudWatch, Datadog, Sentry).
  • Scripting and automation.
  • Strong communication for runbooks, post-mortems, design docs.

Technologies

  • AWS, Terraform
  • TypeScript, Node.js, React, Python
  • PostgreSQL
  • Docker, AWS ECS, GitHub Actions, Spacelift
  • Datadog, Sentry, Mixpanel
  • OAuth 2.0, SAML, OIDC
  • RESTful APIs

Compensation

  • Salary: $220,000 - $300,000/year
  • Incentive Stock Options, sign-on bonus
  • Medical, dental, vision insurance
  • Meals and snacks, gym membership, commuter benefits, relocation
  • Take what you need PTO, $1,000 learning stipend, tech equipment

Skills

AWSTerraformDockerPostgresTypeScriptNode.jsCI/CDGitHub ActionsDatadogSentryOAuthSAMLREST APIsECSPython

Similar roles

DevOps / SRE jobs
Sfcompute

HPC/ GPU Cluster Architect

SfcomputeSan Francisco, CA

Designs, architects, and scales production GPU/HPC clusters globally. Debugs hardware/software issues, automates operations, and mentors juniors. Requires 5+ years experience and hybrid SF presence.

220k – 300k/yr
Hybrid5+ YOEDevOps / SRE
Perplexity

AI Infra Engineer

PerplexitySan Francisco, CA +1

Builds, deploys, and optimizes large-scale Kubernetes and Slurm clusters for AI training and inference. Requires 3+ years in ML infrastructure, expert Kubernetes/Slurm admin, Python/C++, and PyTorch experience.

220k – 405k/yr
On-site3+ YOEDevOps / SRE
Scale AI

Infrastructure Software Engineer, Enterprise GenAI

Scale AISan Francisco, CA +2

Build and scale enterprise GenAI infrastructure across multi-cloud providers (AWS, Azure, GCP), implementing integrations and architecting systems for regulated industries. Requires 4+ years experience, proficiency in Python/JS/SQL, Kubernetes, and AI technologies like LLMs.

216k – 270k/yr
On-site4+ YOEDevOps / SRE
OpenRouter

Software Engineer, Platform

OpenRouterUnited States

Owns and scales platform infrastructure including edge/cloud services on Cloudflare, GCP, Vercel and data layers like Spanner, ClickHouse, Postgres to serve millions of LLM requests daily. Requires 5+ years in production infrastructure with cloud platforms, databases, and full-stack TypeScript expertise.

215k – 285k/yr
Remote5+ YOEDevOps / SRE
OpenAI

Software Engineer, Productivity - Inference Runtime

OpenAISan Francisco, CA

Builds and improves CI/CD, testing, validation, and release tooling for OpenAI's inference runtime teams to ensure reliable, performant model deployments across ChatGPT, API, and research workloads. Requires strong Python skills, developer productivity experience, and high ownership in ambiguous environments.

230k – 385k/yr
On-siteDevOps / SRE