Skip to content
Lightning AILightning AINew York, NY

Infrastructure Engineer (Storage)

Operate and scale distributed storage systems like VAST and Ceph for AI/ML workloads, build Python automation tools, manage Linux bare-metal systems, and collaborate on infrastructure optimizations. Requires 5+ years in infrastructure engineering with storage expertise.

180k – 200k/yr
Remote5+ YOEDevOps / SRE

About the role

What You'll Do

Storage Systems & Infrastructure

  • Operate and scale distributed storage systems, including VAST and S3-compatible object storage (e.g., Ceph)
  • Improve performance, reliability, and efficiency of storage systems supporting large-scale AI/ML workloads
  • Troubleshoot complex storage and data path issues across hardware and software layers
  • Optimize storage performance to support high-throughput, low-latency AI training and inference workloads

Automation & Tooling

  • Build and maintain automation for provisioning, managing, and monitoring storage infrastructure
  • Develop Python-based tools and workflows to reduce manual operational overhead
  • Improve lifecycle management of storage clusters, from deployment through maintenance and scaling

Systems & Operations

  • Manage and operate Linux-based systems in production, including bare-metal environments
  • Partner with infrastructure and data center teams on hardware bring-up, upgrades, and issue resolution
  • Support capacity planning, utilization tracking, and forecasting for storage systems
  • Leverage monitoring and telemetry to diagnose issues and improve system performance and reliability

Cross-Functional Collaboration

  • Work closely with Infrastructure Engineering, Network Engineering, and Platform teams to integrate storage into the broader platform
  • Contribute to design discussions around new infrastructure deployments and scaling strategies
  • Help define best practices for operating storage systems in high-performance computing environments

What You'll Need

Required Qualifications

  • 5+ years of experience in infrastructure engineering, systems engineering, or related roles
  • Hands-on experience operating distributed storage systems (e.g., VAST, Ceph, or similar)
  • Strong Linux systems experience in production environments
  • Proficiency in Python or similar scripting/programming languages for automation
  • Experience working with bare-metal infrastructure and hardware-oriented systems
  • Ability to debug complex issues across system boundaries (storage, OS, hardware, networking)
  • Experience with storage networking protocols (e.g., NFS or similar)
  • Experience with capacity planning, monitoring, and performance tuning

Ideal Experience

  • Experience with VAST storage systems in production environments
  • Experience operating S3-compatible object storage at scale
  • Data center operations experience, including working with physical hardware
  • Familiarity with AI/ML or HPC workloads and their storage requirements
  • Background in high-performance or low-latency distributed systems
  • Familiarity with high-performance data transfer technologies (e.g., RDMA, GPU Direct Storage)
  • Experience supporting GPU-based workloads or large-scale compute clusters

Compensation

Anticipated annual base salary range: $180,000—$200,000 USD

Skills

VastCephLinuxPythonBare-MetalNfsS3RdmaGpu Direct StorageMonitoring

Similar roles

DevOps / SRE jobs
Govsignals

Platform Engineer

GovsignalsNew York, NY

Platform Engineer building and scaling data ingestion, storage, search, and deployment infrastructure across commercial, FedRAMP High, and IL5 environments. Requires 5+ years in backend/platform/infra roles with deep experience in Postgres, Kubernetes, and TypeScript/Python.

180k – 250k/yr
Hybrid5+ YOEDevOps / SRE
Fluidstack

Network Engineer, Design & Engineering

FluidstackNew York, NY +4

Design end-to-end datacenter network architectures for AI training and inference workloads. Own topology selection, fabric design, physical infrastructure integration, and produce deployable HLDs/LLDs across multiple GPU platforms and customer requirements.

180k – 300k/yr
On-site5+ YOEDevOps / SRE
Hightouch

Developer Productivity Engineer

HightouchUnited States

As a Senior Developer Productivity Engineer, you will own the build, test, and deployment processes for a 50+ person engineering team. You will improve monorepo productivity, drive excellence in testing, and support multi-cloud/multi-region infrastructure to enable fast and safe shipping.

180k – 320k/yr
Remote5+ YOEDevOps / SRE
Baseten

Data Center Network Engineer

BasetenSan Francisco, CA +1

Design and own high-performance data center network infrastructure for GPU clusters, including fabric architecture, cabling, and performance validation. Requires deep experience with InfiniBand, RDMA, or high-performance Ethernet at a senior level.

180k – 360k/yr
Hybrid5+ YOEDevOps / SRE
Lightning AI

Infrastructure Engineer (Observability)

Lightning AINew York, NY +2

Builds and operates scalable observability platforms for metrics, logs, traces across GPU, HPC infrastructure. Designs telemetry pipelines, alerting, and multi-tenant systems using Prometheus, Grafana, Kafka; requires 5+ years SRE/infra experience.

180k – 200k/yr
Remote5+ YOEDevOps / SRE