Skip to content
HarveyHarveySan Francisco, CA

Senior Software Engineer, Core Infrastructure

Designs, builds, and scales core infrastructure for Harvey's AI platform, focusing on multi-cloud systems (Azure, GCP), Kubernetes, and observability. Requires 4+ years in infrastructure engineering with strong IaC and distributed systems expertise.

200k – 250k/yr
Hybrid4+ YOEDevOps / SRE

About the role

What You’ll Do

  • Design and build scalable, fault-tolerant infrastructure systems that power Harvey's AI platform across multiple cloud regions
  • Own and evolve our multi-cloud infrastructure (Azure, GCP), including Kubernetes orchestration, networking, and container management
  • Lead technical initiatives around observability, incident response, and operational excellence
  • Architect and optimize our distributed systems for reliability, including load balancing, quota management, and failover mechanisms
  • Partner with Product Engineering and Security teams to ensure infrastructure accelerates product development
  • Drive infrastructure-as-code practices using tools like Terraform and Pulumi
  • Mentor junior engineers and raise the technical bar through code reviews, design reviews, and technical leadership

What You Have

  • 4+ years of experience in Infrastructure Engineering or Platform Engineering in a production environment
  • Long track record building and scaling complex, large-scale distributed systems
  • Deep proficiency with cloud infrastructure platforms (Azure preferred; GCP or AWS experience transfers well)
  • Strong fluency in Infrastructure as Code (IaC) tools — Terraform, Pulumi, or CloudFormation
  • Solid understanding of Kubernetes, container orchestration, networking, and cloud security at scale
  • Experience with observability tools (Datadog, Sentry) and incident response practices (PagerDuty, Incident.io)
  • Strong programming skills in Python, Go, or similar languages

Nice to Have

  • Experience building infrastructure for AI/ML workloads or high-throughput inference systems
  • Background with distributed rate limiting, load balancing, or quota management systems
  • Experience operating multi-tenant platforms with strict security and compliance requirements
  • Track record of leading complex cross-functional projects

Skills

KubernetesAzureGCPTerraformPulumiPythonGoDatadogSentryPagerduty

Similar roles

DevOps / SRE jobs
Decagon

Senior Software Engineer, Cloud Infrastructure

DecagonSan Francisco, CA +1

Build and operate scalable cloud infrastructure platforms, abstractions, and enterprise deployments for Decagon's agentic AI systems. Requires 4+ years in infrastructure/DevOps, deep expertise in Kubernetes, Terraform, major cloud providers, networking, and production reliability (monitoring, on-call).

200k – 400k/yr
On-site7+ YOEDevOps / SRE
Together AI

Senior Software Engineer, Observability

Together AISan Francisco, CA

Senior Software Engineer building scalable observability platforms (metrics, logs, traces) with Prometheus, Grafana, OpenTelemetry and related tools for Together AI's GPU cloud infrastructure. Requires strong distributed systems and infrastructure-as-code experience.

200k – 280k/yr
On-site5+ YOEDevOps / SRE
Baseten

Software Engineer

BasetenSan Francisco, CA

Lead Software Engineer building real-time observability and root-cause analysis for Baseten's large-scale GPU fabrics and high-performance networks. Requires strong distributed systems and infrastructure experience to correlate telemetry from switches, NICs, GPUs, and inference services.

200k – 380k/yr
Hybrid7+ YOEDevOps / SRE
Snowflake

Senior Software Engineer, Accelerated Delivery

SnowflakeMenlo Park, CA

Build and evolve continuous deployment, progressive delivery, and AI-augmented release platforms for safe, large-scale multi-cloud rollouts on Kubernetes at Snowflake. Requires strong systems programming (Golang/Java/C++), Kubernetes, observability, and DevOps experience.

200k – 288k/yr
Hybrid5+ YOEDevOps / SRE
Snowflake

Senior Software Engineer - Snowpark Container Service

SnowflakeBellevue, WA +1

Senior engineer to design, build, and lead development of Snowpark Container Services, a Kubernetes-based container compute platform. Requires 7+ years building large-scale distributed systems and strong coding skills in Java, C++, or Go.

200k – 288k/yr
Hybrid7+ YOEDevOps / SRE