# Platform Engineer, Model Shaping

**Company:** [Together AI](https://hotfix.jobs/companies/together-ai)
**Location:** San Francisco, CA
**Role:** DevOps / SRE
**Salary:** $200k – $290k/yr
**Experience:** 3+ years
**Skills:** Python, Go, Kubernetes, Terraform, Ansible, Prometheus, Grafana, GitHub Actions, Argo CD, AWS, GCP, Azure, Linux
**Posted:** 2026-06-23

> Build and operate backend services and infrastructure for model customization and evaluation at Together AI. Requires 3+ years building production infrastructure, strong Python/Go skills, and deep experience with Kubernetes, Linux, and cloud platforms.

## Job Description

## Responsibilities
- Design and build Together’s systems and infrastructure for model customization, including user-facing features and internal improvements
- Contribute to reliability improvements for the platform, participating in an on-call rotation and improving processes for incident response
- Create and improve internal tooling for deployment, continuous integration, and observability
- Build a job orchestration platform spanning multiple datacenters, supporting a highly heterogeneous hardware landscape
- Partner with teams developing internal services, co-designing these services and incorporating them in systems built within Together

## Requirements
- 3+ years of experience in building infrastructure or backend components of production services
- Extensive experience designing, operating, and troubleshooting production Linux environments and Kubernetes-based platforms
- Strong software engineering background in Python or Go
- Experienced with infrastructure automation tools (Terraform, Ansible), monitoring/observability stacks (Prometheus, Grafana), and CI/CD pipelines (GitHub Actions, ArgoCD)
- Cloud environment (e.g., AWS/GCP/Azure) administration experience, preferably with a hybrid bare-metal/cloud environment
- Strong communication skills, be willing to document systems and processes and collaborate with peers of varying technical expertise
- Comfortable operating across the stack, from cluster operations and infrastructure automation to backend service development

## Nice-to-Haves
- Developing large-scale production systems with high reliability requirements
- Pipeline orchestration frameworks (e.g., Kubeflow, Argo Workflows, Flyte)
- Managing GPU workloads on HPC clusters, ideally with hands-on experience in operating NVIDIA’s networking stack (e.g., NCCL, Mellanox firmware, GPUDirect RDMA)
- Deployment of services for AI training or inference
- Networking fundamentals, including TCP/IP, DNS, routing, load balancing, TLS, and network debugging tools
- Maintaining or contributing to open-source projects

## Compensation & Benefits
- Competitive compensation, startup equity, health insurance, and other benefits
- Flexibility in terms of remote work
- US base salary range: $200,000 - $290,000

## Similar roles

- [Development Engineer, Facility Software Automation](https://hotfix.jobs/jobs/bb3c03b1-8926-464e-a398-05bd074da434) - Fluidstack - Austin, TX - $200k – $250k/yr
- [Platform Engineer](https://hotfix.jobs/jobs/ba7cacc6-77c9-41bf-9c28-55e1e217737e) - Fluidstack - San Francisco, CA - $200k – $250k/yr
- [Infrastructure Engineer](https://hotfix.jobs/jobs/7d0413e3-d528-4261-9634-f40b227d6bc5) - Console - San Francisco, CA - $200k – $350k/yr
- [Platform Engineer](https://hotfix.jobs/jobs/02b62051-376e-4871-89be-33a0fd2ea48b) - Kepler - New York, NY - $200k – $280k/yr
- [SRE/Infrastructure Engineer](https://hotfix.jobs/jobs/10c1f0ca-96a6-4432-9da8-b41b9d6b0530) - E2b - San Francisco, CA - $200k – $350k/yr

**Apply:** https://hotfix.jobs/jobs/619d32fb-c64d-4f71-b535-530d2474eed2
**Canonical:** https://hotfix.jobs/jobs/619d32fb-c64d-4f71-b535-530d2474eed2