Skip to content
Together AITogether AISan Francisco, CA

Infrastructure Design Engineer

Designs whitespace environments for large-scale AI GPU clusters, including rack layouts, power, cooling, and cabling. Reviews contractor designs, ensures compliance with standards, and owns capacity planning. Requires 7+ years in data center infrastructure.

210k – 250k
Hybrid7+ YOEDevOps / SRE

About the role

Responsibilities

  • Architect HPC clusters by designing whitespace layouts, including rack placement, aisle configuration, hot/cold aisle containment, equipment density, and airflow strategy for high-density GPU deployments
  • Collaborate with electrical and mechanical engineers to integrate power and cooling infrastructure into whitespace environments
  • Collaborate with Network Engineering to define and validate physical layer requirements (structured cabling, pathway planning, port density) for high-speed AI cluster interconnects, ensuring design compatibility with both physical and logical network architectures
  • Advise Data Center build teams/contractors to ensure data center build out matches design and architecture specifications. Provide direction to optimize performance, scalability and cost-effectiveness
  • Develop and maintain CAD/BIM drawings, schematics, capacity planning models, and technical documentation to support site design, construction, operations, and audits of data center white space
  • Own capacity planning within the white space through modeling that incorporates growth, utilization, and infrastructure scaling
  • Validate electrical and mechanical load distribution across whitespace fit-outs, including review of striping plans and upstream load balancing under normal and failover conditions
  • Partner with Infrastructure Strategy and Operations by providing design review and technical guidance during the white space fit-out phase
  • Drive continuous improvement in design standards, build processes, and quality assurance, including identifying opportunities to improve infrastructure reliability, reduce time-to-rack, and apply new technologies such as liquid cooling and high-density power architectures
  • Ensure all designs comply with applicable standards including TIA-942, Uptime Institute Tier guidelines, ASHRAE thermal recommendations, and relevant local codes and safety regulations

Requirements

  • 7+ years of experience in data center design, critical facilities engineering, or infrastructure delivery, with deep technical knowledge across the full stack (power, cooling, network) as it pertains to white space design and implementation
  • Demonstrated experience serving as an owner's engineer or resident engineer, including reviewing consultant drawings, managing contractor compliance, and interpreting construction specifications and submittal documents
  • Strong working knowledge of how facility electrical (UPS, switchgear) and cooling (CRAC/CRAH) infrastructures interface with, and support, high-density white space systems (PDUs, in-row cooling, CDUs, RPPs)
  • Proficiency with CAD/BIM tools such as AutoCAD, Revit, or equivalent; ability to produce and review technical drawings, schematics, and capacity models
  • Working knowledge of industry standards including TIA-942, Uptime Institute Tier classifications, ASHRAE thermal guidelines, and ANSI/BICSI; familiarity with local building codes and safety regulations
  • Proven ability to manage multiple concurrent projects across different sites and work effectively with MEP engineers, general contractors, and equipment vendors in fast-moving environments
  • Willingness to travel to data center sites as required for technical due diligence, design inspections, and final white space deployment sign-off

Nice to Have

  • Experience with liquid cooling systems for high-density GPU clusters, including direct liquid cooling (DLC), immersion cooling, or rear-door heat exchangers, and familiarity with associated power and plumbing infrastructure
  • Background in hyperscale or AI-native infrastructure deployments, including reference architecture validation, and the development of final design acceptance criteria at scale
  • Familiarity with DCIM platforms, telemetry and monitoring systems, and infrastructure-as-code tooling for capacity and utilization tracking

Compensation

US base salary range: $210-250K + equity + benefits. Salary determined by location, level, role, experience, skills, and job-related knowledge.

Skills

AutocadRevitCad/BimTia-942Uptime Institute TierAshraeAnsi/BicsiDcimLiquid CoolingDlcPdusRppsCdusCrac/CrahUps

Similar roles

DevOps / SRE jobs
Tines

Senior Site Reliability Engineer - Government Cloud

TinesUnited States

Build and operate AWS GovCloud infrastructure for federal customers, owning IaC, container pipelines, compliance documentation, and operational tooling. Requires 5+ years AWS experience and FedRAMP familiarity.

210k – 220k
Remote5+ YOEDevOps / SRE
Alembic

Senior Network & Site Reliability Engineer

AlembicSan Francisco, CA

Design, operate, and automate the global network and reliability layer for a high-performance NVIDIA DGX SuperPOD supporting ML workloads. Own architecture, observability, incident response, and security for mission-critical infrastructure.

210k – 240k
On-site8+ YOEDevOps / SRE
Alembic

Senior Site Reliability Engineer

AlembicSan Francisco, CA

Builds and maintains scalable infrastructure for real-time analytics and ML workloads, focusing on reliability, automation, CI/CD, monitoring, and incident response. Requires 8+ years SRE/DevOps experience with Kubernetes, Terraform, Linux, and observability tools.

210k – 240k
On-site8+ YOEDevOps / SRE
Abridge

Senior Software Engineer, SRE

AbridgeSan Francisco, CA +2

Senior SRE improves performance, stability, and scalability of distributed systems through load testing, chaos engineering, observability, and infrastructure migrations. Requires 8+ years in distributed systems, Kubernetes, GCP, and backend languages like Python/Go.

211k – 248k
Hybrid8+ YOEDevOps / SRE
Crusoe

Senior Production Engineer

CrusoeSan Francisco, CA +1

As a Senior Production Engineer, you will ensure the reliability and scalability of Crusoe’s AI-optimized cloud platform, focusing on designing and operating managed AI services for LLM workloads. You will build automation and reliability tooling, define SLIs/SLOs, and optimize large-scale training and inference clusters.

209k – 253k
On-siteDevOps / SRE