Infrastructure Engineer
Infrastructure Engineer scales ML inference systems serving 150+ biological models using Kubernetes and AWS. Requires containerization expertise, cloud knowledge, and onsite presence in San Francisco.
About the job
Responsibilities
- Architect and maintain infrastructure serving 150+ biological ML models
- Scale platform several orders of magnitude to meet growing demand
- Orchestrate containerized workloads using Kubernetes
- Optimize resource allocation and ensure high availability
- Work closely with founders on customer needs, unpredictable workloads, and Bio-ML models
Requirements
- Solid programming and automation skills
- Experience with containerization and orchestration concepts
- Cloud platform knowledge (AWS/GCP/Azure)
- Located in the SF Bay Area or able to relocate
Preferred
- Experience scaling production systems
- Kubernetes experience
- Infrastructure as code tools (Terraform, Pulumi)
- Monitoring and observability tools
- Experience with GPU workloads
Tech Stack: Python, React, AWS (EC2, S3, DynamoDB), Docker, CUDA, Conda, TensorFlow/PyTorch, notebooks, bash/Slurm, APIs & web apps
Skills
Kubernetes, AWS, Docker, Terraform, Python, GPU, CUDA, Pulumi, TensorFlow, PyTorch
Similar jobs
DevOps / SRE jobs
Cloudflare
Austin, TXBuild and operate a highly available, multi-region PostgreSQL platform, developing automation, monitoring, disaster recovery, and performance tooling. Requires experience with large-scale PostgreSQL clusters, infrastructure as code, scripting, containers, and observability.
Fluidstack
New York, NYLeads on-site deployment of data center physical infrastructure, managing contractors, performing QA/QC on fiber optics and cabling, and ensuring compliance with standards. Requires 5+ years experience, SME-level fiber optic expertise, bachelor's degree, and 40% travel readiness.
Trexquant
New York, NY
The Python Engineer will improve and operate trading systems, support integrations with asset classes and prime brokers, and handle monitoring, incidents, and performance optimization. The role requires 3+ years of experience, strong Python and Linux skills, and familiarity with market data and order-entry systems.
Teleport
United States
Build IT workflow automation and security tooling using Go, Temporal, Kubernetes, Terraform, and shell scripting. The role also supports internal IT systems and integrations across endpoint management, identity, access, and security administration.
SimplePractice
United States
The DevOps Engineer will build and operate reliable infrastructure, deployment workflows, and observability for data pipelines and AI/ML systems. The role requires at least three years of DevOps, SRE, or infrastructure experience plus strong cloud, Terraform, containerization, and MLOps expertise.