Skip to content
LlamaIndexLlamaIndexSan Francisco, CA

Senior Infra Engineer

Builds and scales core infrastructure including Kubernetes clusters and cloud resources to power AI data platform. Collaborates with teams on foundational systems, optimizes for cost/performance, and ensures security/compliance. Requires 5+ years infra experience.

180k – 250k/yr
Hybrid5+ YOEDevOps / SRE

About the role

Responsibilities

  • Collaborate with other engineering teams to build and maintain foundational systems that empower developers and support the company's rapid growth.
  • Design and implement scalable infrastructure solutions for various deployment models, including SaaS, single-tenant, and private deployments.
  • Manage and optimize cloud resources and Kubernetes clusters for cost-effectiveness and performance.
  • Enable external customer deployment success through maintaining clear infrastructure boundaries and principles.
  • Optimize and improve the release and deployment processes to enhance efficiency and reliability.
  • Ensure compliance with relevant regulations and implement robust security measures across different deployment environments.

Qualifications

  • 5+ years of engineering experience.
  • Worked on Platform or Infrastructure teams on significant projects involving infrastructure components (Terraform/CDKTF, Kubernetes, Helm, test infrastructure, release management, observability, etc.).
  • Experience in optimizing cloud resource utilization. Proficient in tuning Kubernetes clusters and cloud resources for cost and performance efficiency.
  • Willing to build LlamaIndex's engineering culture as we grow.
  • You can balance speed and pragmatism and build the appropriate solutions for each stage of the company's growth.

Preferred Qualifications

  • Experience building out infrastructure from the ground up at a fast-growing startup.
  • Experience with observability tools like Prometheus, Grafana, New Relic.
  • Experience with GitOps tools like ArgoCD and Flux for continuous deployment.
  • Experience with security compliance and audits in cloud environments such as SOC2.
  • Familiar with Python, Postgres, multi-cloud deployments.

Skills

KubernetesTerraformHelmPrometheusGrafanaArgo CDFluxPythonPostgresCdktf

Similar roles

DevOps / SRE jobs
Onebrief

Senior Site Reliability Engineer (Arlington, VA)

OnebriefArlington, VA

Site Reliability Engineer owning reliability, observability, incident response, and automation for mission-critical on-prem DoD and AWS deployments. Requires active Top Secret clearance, 5+ years SRE/Platform experience, Kubernetes, Terraform, and strong incident management skills.

180k – 220k/yr
Remote5+ YOEDevOps / SRE
AcuityMD

Senior Software Engineer, Infrastructure

AcuityMDBoston, MA

Senior Infrastructure Engineer responsible for building and operating platform primitives including Kubernetes, CI/CD, observability, and developer tooling at a high-growth AI and data platform company.

180k – 250k/yr
Hybrid5+ YOEDevOps / SRE
Casca

Senior Infrastructure Engineer

CascaSan Francisco, CA

As a Senior Infrastructure Engineer, you will own and evolve the foundational systems powering Casca's AI-driven lending platform. You will build and maintain infrastructure, CI/CD pipelines, cloud infrastructure, deployment automation, and observability systems, ensuring the platform is secure, compliant, and highly available.

180k – 215k/yr
On-site5+ YOEDevOps / SRE
Onebrief

Senior Release Engineer

OnebriefUnited States

As a Senior Release Engineer, you will design, maintain, and improve deployment processes, build and scale CI/CD systems, and manage production environments. You will partner with engineering teams to eliminate bottlenecks and enhance platform resilience.

180k – 200k/yr
Remote4+ YOEDevOps / SRE
AKASA

Sr. Software Engineer, DevOps

AKASASouth San Francisco, CA

Builds and scales reliable infrastructure for SaaS applications using Kubernetes, Terraform, and GitHub CI/CD. Focuses on observability with Grafana/Prometheus, automation to reduce toil, production troubleshooting, and cross-team collaboration. Requires 5+ years Python experience.

180k – 220k/yr
Hybrid5+ YOEDevOps / SRE