Skip to content
RoboflowRoboflowNew York, NY

Infrastructure Engineer

Infrastructure Engineer responsible for securing, scaling, and maintaining cloud architecture, Kubernetes clusters, ML pipelines, and CI/CD systems at a computer vision AI startup. Must have production Kubernetes, IaC, and AWS/GCP experience.

165k – 200k
HybridDevOps / SRE

About the role

What You'll Do

As a member of our infrastructure team, you'll be at the heart of a fast-paced startup environment. Your primary focus will be on striking the right balance between rapid delivery, high reliability, and robust security. You'll act as an infrastructure engineer, developer, or security analyst as needed.

You will be securing, scaling, and maintaining the core infrastructure that powers our product. This includes our cloud architecture, databases, file storage, search clusters, microservices, and machine learning pipelines. You'll work closely with our product team and collaborate across the company on product, operations, and customer-facing projects.

Skillset

  • Production experience with Kubernetes: Building and managing containerized applications at scale.
  • Infrastructure-as-Code (IaC): Using Terraform, Helm charts, bash scripting, and Python to automate everything.
  • Scale & Site Reliability: Operating, monitoring, and scaling large-scale applications (especially in ML/AI) in AWS and/or GCP.
  • Development Skills: Proficiency in Node.js and Python, with the ability to collaborate with full-stack developers on designing and operating SaaS applications.
  • ML/Big Data Ops: Hands-on experience with the infrastructure required for machine learning at scale (GPUs, Docker, Kubernetes) and familiarity with libraries like PyTorch or Tensorflow.
  • CI/CD Automation: Experience with tools like GitHub Actions or Spacelift to build and deploy code efficiently.
  • Pragmatic Security: Awareness of security best practices for cloud operations and how they can be applied to startup environments.
  • AI-Native Engineering: Leveraging LLMs and AI tools to accelerate the development lifecycle.

A Glimpse of Your Work

  • Running and optimizing a high-availability machine learning inference service.
  • Collaborating with customer security teams to ensure secure integration.
  • Developing creative IaC solutions to scale our platform cost-effectively.
  • Working with the engineering team to define SLOs/SLAs and participating in incident response.
  • Improving the Observability and Alerting stack and the processes built around it.
  • Diving deep into our stack to identify and act on cost-optimization opportunities.
  • Contributing code (Python, JavaScript, etc.) as part of a team designing and deploying new product features.
  • Fixing security vulnerabilities and bugs.
  • Hardening our systems and processes to meet SOC 2, HIPAA, and GDPR requirements.
  • Participating in an on-call rotation to ensure platform reliability.

Compensation & Benefits

  • $4000/yr Travel Stipend
  • $350/mo Productivity stipend

Skills

KubernetesTerraformHelmPythonNode.jsAWSGCPDockerPyTorchTensorFlowGitHub ActionsCI/CD

Similar roles

DevOps / SRE jobs
Octus

DevOps Engineer

OctusNew York, NY

Design, implement, and maintain cloud infrastructure and CI/CD pipelines. Collaborate with developers, SRE, and Security to ensure system reliability, scalability, and security.

165k – 190k
On-site5+ YOEDevOps / SRE
Baseten

OS / K8s Systems Engineer

BasetenSan Francisco, CA +1

Build automation and systems to provision and orchestrate GPU hardware into scalable Kubernetes clusters. Requires deep Linux expertise, provisioning experience, and strong programming in Python/Go.

165k – 330k
HybridDevOps / SRE
Baseten

Site Reliability Engineer (SRE)

BasetenSan Francisco, CA +1

Site Reliability Engineer builds and maintains scalable infrastructure for ML model deployment, automates CI/CD pipelines, and ensures reliability using tools like Kubernetes and Terraform. Collaborates cross-functionally, owns projects end-to-end, and mentors juniors; bachelor's in CS or related field required.

165k – 330k
HybridDevOps / SRE
Baseten

Software Engineer - Internal Platform

BasetenSan Francisco, CA +1

Builds internal tooling, monorepos, CI/CD pipelines, and shared libraries to boost engineering productivity. Requires strong proficiency in Go/Python, Kubernetes/Docker experience, and monorepo management.

165k – 330k
HybridDevOps / SRE
Baseten

Software Engineer - Infrastructure

BasetenSan Francisco, CA +1

Builds and maintains infrastructure components for ML inference platform using Python and Go. Implements Kubernetes deployments, monitoring systems, and resource management for efficient model serving, requiring Kubernetes knowledge and ML basics.

165k – 330k
HybridDevOps / SRE