# IT Engineer, Internal AI Infrastructure

**Company:** [Figma](https://hotfix.jobs/companies/figma)
**Location:** Remote
**Role:** IT Support
**Salary:** $153k – $296k/yr
**Experience:** 5+ years
**Skills:** Infrastructure, Platform Engineering, Backend Engineering, System Design, Llm Operations, Model Routing, Agent Runtimes, Observability, Audit Logging, Cost Attribution, Okta, Single Sign-On, Service-To-Service Authentication, Mcp, Sox
**Posted:** 2026-08-27

> Build the shared hosting, model-routing, observability, security, and cost infrastructure that enables employees to deploy governed internal AI applications. The role requires at least five years of software engineering experience, strong platform or backend expertise, and hands-on LLM operations experience.

## Job Description

## Responsibilities
- Design and build the hosting golden path for internal AI applications, bots, and agents, including runtime patterns for long-running workflows, scheduled jobs, and agent execution.
- Build model routing that directs tasks across frontier and lower-cost models based on cost, capability, and policy, with a complete audit trail.
- Establish observability, usage analytics, audit logging, and per-team cost attribution for company-wide AI workloads.
- Integrate enterprise identity, access, and security patterns, including Okta-connected defaults, so internal AI applications are secure from launch.
- Create sanctioned workflows for applications handling customer, financial, or people data.
- Partner with product AI infrastructure teams to share gateways and telemetry rather than building duplicate systems.
- Help shape platform strategy, roadmap, and engineering practices as a founding member of the infrastructure pillar.

## Requirements
- 5+ years of software engineering experience, including significant infrastructure, platform, or backend engineering experience.
- Experience building internal platforms or paved paths adopted by engineering teams.
- Strong system design skills and experience architecting resilient, observable production systems.
- Hands-on experience with LLM operations, such as model gateways or routing, agent runtimes, evaluations, or cost and usage instrumentation.
- Experience with enterprise identity and access management, such as Okta, SSO, and secure service-to-service authentication.
- Excellent communication and cross-functional collaboration skills across security, IT, and business teams.

## Nice-to-haves
- Experience building internal AI platforms, workspaces, or developer platforms at comparable scale.
- Familiarity with MCP, agent orchestration frameworks, or skill and plugin registry patterns.
- Experience with audit and compliance programs such as SOX or ITGC, or building systems with audit requirements.
- Experience as the first infrastructure hire on a small team and setting standards across a broad scope.

## Compensation and Benefits
- Annual base salary: **$153,000–$296,000 USD**.
- Equity and benefits including health, dental, and vision coverage; retirement contributions; parental leave; family planning support; mental health and wellness benefits; paid time off; holidays; and other company benefits.

## Similar jobs

- [IT Security & Operations Manager](https://hotfix.jobs/jobs/237e19ee-fc9b-487d-ab6d-9500d1b88d48) - Juicebox - San Francisco, CA - $150k – $215k/yr
- [People Systems Administrator, Workday](https://hotfix.jobs/jobs/35073c1b-3da6-4e02-baa5-58b62f240e6d) - Vanta - Remote - $149k – $175k/yr
- [Technology Operations Specialist (L3) - Job Posting](https://hotfix.jobs/jobs/d966f378-6a0a-44bf-9934-267a6d31d005) - Mercor - San Francisco, CA - $160k – $190k/yr
- [IT Support Engineer](https://hotfix.jobs/jobs/a84077d7-b595-42fd-826f-50ca000368a9) - Collective Intelligence Project - San Francisco, CA - $160k – $189k/yr
- [IT Site Specialist](https://hotfix.jobs/jobs/bee33ebf-5c73-4e7e-863f-fc229aec182d) - Ramp - San Francisco, CA - $146k – $200k/yr

**Apply:** https://hotfix.jobs/jobs/d85eae55-6af7-45db-95c9-e788b65ebbcd
**Canonical:** https://hotfix.jobs/jobs/d85eae55-6af7-45db-95c9-e788b65ebbcd