# Infrastructure Engineer, Security

**Company:** [Thinking Machines Lab](https://hotfix.jobs/companies/thinking-machines-lab)
**Location:** San Francisco, CA
**Role:** Security Engineering
**Salary:** $200k – $475k/yr
**Skills:** Kubernetes, Terraform, Rust, Python, IAM, Vpcs, Mtls, RBAC, CI/CD, Gpu Clusters
**Posted:** 2026-05-04

> Owns and evolves security infrastructure across compute, storage, networking, and data platforms for foundation models. Architects secure patterns, manages identities/secrets, builds threat models, and automates security checks in Kubernetes/cloud environments. Requires strong systems programming and infra experience.

## Job Description

## What You’ll Do

- Architect security patterns for platforms and services, including network segmentation, service-to-service authentication, **RBAC**, and policy enforcement in **Kubernetes** and cloud environments.
- Manage identity, access, and secrets for humans and services: workload and cross-cloud identity, least-privilege **IAM**, and secrets management.
- Build secure platforms for data ingestion, processing, and curation: classification, encryption, access controls, and safe sharing patterns across teams.
- Write threat models and review designs with researchers and engineers to help them ship features and experiments in a safe, scalable way.
- Automate security checks and build guardrails: **policy-as-code**, secure infrastructure baselines, validation in **CI/CD**, and tools that make the secure path the easiest one.

## Skills and Qualifications

### Minimum qualifications

- Bachelor’s degree or equivalent experience in engineering, or similar.
- Strong background with containers and orchestration (**Kubernetes**) and how to secure them (namespaces, network policies, pod security, admission controls, etc.)
- Practical experience with **Infrastructure as Code** (**Terraform** or similar), including secure patterns for provisioning networks, **IAM**, and shared services.
- Solid understanding of cloud networking and security: **VPCs**, load balancers, service discovery, **mTLS**, firewalls, and zero-trust-style architectures.
- Proficiency with a systems language such as **Rust** and scripting in **Python** for building platform components and internal tools.
- Evidence of owning complex, production-critical systems, including debugging issues that span infra, security, and application layers.

### Preferred qualifications

- Experience with **ML infrastructure**, **GPU clusters**, or large-scale training environments (schedulers, job queues, shared storage, multi-tenant clusters).
- Background in AI labs, **HPC** environments, or ML-heavy organizations where both security and performance are first-class concerns.
- Experience profiling and tuning high-throughput systems, and an ability to reason about the cost of additional security layers.
- Talks, blogs, or publications on infrastructure security, distributed systems, or performance engineering.
- Open-source contributions to security, orchestration, observability, or infrastructure tooling.
- Familiarity with securing specialized hardware (**GPUs**, **TPUs**) and their integrations into training and inference pipelines.

## Logistics

**Compensation**: Depending on background, skills and experience, the expected annual salary range for this position is **$200,000 - $475,000 USD**.

**Benefits**: Generous health, dental, and vision benefits, unlimited PTO, paid parental leave, and relocation support as needed.

## Similar roles

- [Security Engineer](https://hotfix.jobs/jobs/9731ca0c-3722-4ec9-9644-4515044e6890) - Nooks - San Francisco, CA - $200k – $315k/yr
- [Platform Engineer, Security](https://hotfix.jobs/jobs/8ec09390-4b0b-4859-96b3-efafc456226c) - Decagon - San Francisco, CA - $200k – $330k/yr
- [Security engineer, detection and response (US)](https://hotfix.jobs/jobs/98c71ebc-3ff0-469d-9a49-eb98d9aec3ac) - Writer - San Francisco, CA - $200k – $240k/yr
- [Software Engineer, Trust](https://hotfix.jobs/jobs/c95c63b6-81e4-4554-b381-9d38e3dd4801) - Notion - San Francisco, CA - $200k – $280k/yr
- [Security Engineer](https://hotfix.jobs/jobs/f0f751da-c4de-43a0-a51c-945a1999b0b7) - Decagon - San Francisco, CA - $200k – $330k/yr

**Apply:** https://hotfix.jobs/jobs/911010b2-5649-4288-bbd0-0172261e1e28
**Canonical:** https://hotfix.jobs/jobs/911010b2-5649-4288-bbd0-0172261e1e28