Senior Technical Program Manager, Infrastructure (TPM)
Senior Technical Program Manager leading large-scale infrastructure programs at Glean to improve scalability, reliability, cost efficiency, and AI/ML platform capabilities. Requires 8+ years in TPM, infrastructure or SRE with strong cloud and cross-functional leadership experience.
About the job
Role Responsibilities
- Drive the company’s Infrastructure roadmap across Setup & Deployment, Runtime, Storage, and AI Infra.
- Lead cross-functional programs that improve scalability, reliability, cost efficiency, and developer velocity.
- Define and orchestrate how Glean instances are deployed, upgraded, and monitored at scale.
- Partner with AI and Data teams to evolve our ML pipelines, model training infrastructure, and LLM serving stack.
- Lead initiatives to improve observability, configuration management, and resource utilization.
- Coordinate capacity planning, infrastructure migrations, and performance optimization programs.
- Build clear visibility into infra cost drivers and partner with finance and engineering leaders on optimization initiatives.
- Lead end-to-end infra programs spanning compute, networking, storage, orchestration, and AI workloads.
- Partner with Engineering to define standards for environment provisioning, deployment automation, and configuration governance.
- Develop and operationalize frameworks for runtime health, scaling, and disaster recovery.
- Drive consistency and automation across deployment orchestration systems.
- Establish clear metrics for reliability, performance, and cost efficiency.
- Coordinate cross-team delivery of high-impact programs such as data pipeline scalability, LLM infrastructure expansion, or infra observability improvements.
- Communicate program status and technical risks effectively to leadership and stakeholders.
- Continuously identify process or system bottlenecks, and drive automation to improve speed and reliability of infra operations.
Requirements
- BS/MS in Computer Science, Engineering, or a related technical field.
- 8-10+ years of experience in technical program management, infrastructure, or SRE, with at least 3-5 years managing infra or platform-scale programs.
- Proven success delivering cross-functional infrastructure programs in B2B or enterprise environments where scalability, uptime, and performance are critical.
- Experience working closely with Infra, SRE, and ML/AI teams on distributed systems or data infrastructure.
- Strong understanding of cloud infrastructure (AWS, GCP, or Azure) including compute, networking, storage, and orchestration systems.
- Ability to structure complex multi-quarter infrastructure programs with clear milestones and measurable impact.
- Strong written and verbal communication and ability to manage through ambiguity, anticipate scaling challenges, and align teams across priorities.
- Builder mindset with focus on automation, reliability, and efficiency.
Nice-to-Haves
- Understanding of data pipelines, ML training workflows, and LLM runtime infrastructure.
Skills
Technical Program Management, Infrastructure, SRE, AWS, GCP, Azure, Ml Pipelines, Llm Infrastructure, Distributed Systems, Observability, Automation, Capacity Planning
Similar jobs
Technical Program Management jobs
Motive
Seattle, WALeads complex, cross-functional platform engineering programs, aligning senior stakeholders, managing dependencies and risks, and improving execution across the organization. Requires 7+ years of technical program management experience, strong technical fluency, executive communication, and a technical bachelor’s degree or equivalent experience.
GitLab
Bengaluru, India
Leads complex, cross-functional technical programs spanning product, engineering, data, and security, translating strategy into predictable execution and scaled adoption. The role requires senior stakeholder leadership, strong communication, risk management, and experience with SaaS, cloud infrastructure, DevOps, or AI/ML initiatives.
Fluidstack
New York, NYLeads Fluidstack’s NPI function, building stage-gate and manufacturing-transfer processes while managing a TPM team and portfolio of hardware programs spanning compute and power equipment. Requires 10+ years in hardware NPI or program management and 3+ years leading TPM or NPI teams.
Figma
San Francisco, CALead cross-functional infrastructure programs at Figma, coordinating reliability, storage, distributed systems, and compliance initiatives across engineering, security, and legal teams. Requires 8+ years of infrastructure TPM experience with deep technical expertise in cloud-native systems.
OpenAI
San Francisco, CA
Leads cross-functional delivery of large-scale AI infrastructure programs from planning through operational handoff, coordinating engineering, construction, hardware, networking, operations, and external partners. Requires 8+ years of complex technical program leadership, strong dependency and risk management, and executive communication skills.