Distributed Systems Engineer
Designs and engineers distributed systems for compute, scheduling, and orchestration of ML and ETL pipelines handling large-scale video data. Requires 3+ years building data infrastructure, proficiency in Go/Python, and experience with petabyte-scale pipelines and CI/CD.
About the job
Requirements
- 3+ years of experience building foundational data infrastructure
- Proficient in working across diverse cloud architectures
- Designed and maintained pipelines that process petabytes of data
- Developed robust CI/CD pipelines tailored for ML-focused teams
- Strong coding experience with Go and Python; Experience with Rust is a plus
- Operates as an IC who leads by example
- Experience with large-scale video data systems
Benefits
- 401k + Full Health Insurance
- Breakfast, Lunch, and Dinner covered and your choice of snacks
- Ubers covered home
Skills
Go, Python, Rust, CI/CD, Kubernetes, Distributed Systems, Cloud Architectures, Etl Pipelines, Ml Pipelines, Video Data Systems
Similar jobs
DevOps / SRE jobsBuild and operate a highly available, multi-region PostgreSQL platform, developing automation, monitoring, disaster recovery, and performance tooling. Requires experience with large-scale PostgreSQL clusters, infrastructure as code, scripting, containers, and observability.
Leads on-site deployment of data center physical infrastructure, managing contractors, performing QA/QC on fiber optics and cabling, and ensuring compliance with standards. Requires 5+ years experience, SME-level fiber optic expertise, bachelor's degree, and 40% travel readiness.
The Python Engineer will improve and operate trading systems, support integrations with asset classes and prime brokers, and handle monitoring, incidents, and performance optimization. The role requires 3+ years of experience, strong Python and Linux skills, and familiarity with market data and order-entry systems.
Build IT workflow automation and security tooling using Go, Temporal, Kubernetes, Terraform, and shell scripting. The role also supports internal IT systems and integrations across endpoint management, identity, access, and security administration.
The DevOps Engineer will build and operate reliable infrastructure, deployment workflows, and observability for data pipelines and AI/ML systems. The role requires at least three years of DevOps, SRE, or infrastructure experience plus strong cloud, Terraform, containerization, and MLOps expertise.