# Senior Backend Engineer

**Company:** [FlexAI](https://hotfix.jobs/companies/flexai)
**Location:** Santa Clara, CA, San Jose, CA
**Role:** Backend Engineering
**Experience:** 5+ years
**Skills:** Go, Kubernetes, Docker, gRPC, Postgres, Cassandra, DynamoDB, Redis, Kafka, Prometheus, Grafana, OpenTelemetry, AWS, GCP, Azure
**Posted:** 2026-03-24

> Architects and builds high-performance Golang backend services for AI PaaS platform, focusing on distributed systems, GPU orchestration, model deployment, and cloud-native infrastructure. Requires 5+ years experience with expert Golang and Kubernetes proficiency.

## Job Description

## What You'll Do

### Core Platform & Infrastructure Backend
- Architect and develop high-performance Golang services for FlexAI's AI PaaS and infrastructure platform
- Build internal APIs powering model deployment, job scheduling, and compute lifecycle management
- Develop components interfacing with GPU/compute infrastructure and AI runtimes

### Distributed Systems & Scalability
- Design and scale microservices and event-driven systems for high-throughput AI workloads
- Optimize for low latency, high concurrency, and fault tolerance
- Implement service-to-service communication (**gRPC/REST**, message queues, async pipelines)
- Drive reliability, observability, and resilience across services

### AI Platform Integration
- Collaborate with AI/ML and Runtime teams to integrate systems with training pipelines, inference infrastructure, experimentation workflows, and dataset/artifact management
- Enable orchestration across cloud and on-prem environments
- Build abstractions that simplify AI infrastructure consumption

### Cloud-Native & Platform Engineering
- Design cloud-native, **Kubernetes-native** services
- Work with DevOps/SRE on CI/CD, deployment automation, and scalability
- Contribute to architecture decisions for multi-region, multi-cloud infrastructure
- Improve monitoring, logging, and diagnostics

### Technical Leadership
- Lead architecture reviews and set engineering standards
- Mentor engineers and guide complex problem-solving
- Drive long-term roadmap for backend infrastructure and AI platform capabilities
- Partner with Product, Runtime, and Infra leadership to translate requirements into scalable systems

**Tech Stack (Indicative):**  
**Languages:** Golang (Primary), Python (Secondary)  
**Infrastructure:** Kubernetes, Docker, Cloud (AWS/GCP/Azure)  
**Architecture:** Microservices, gRPC, Event-driven systems  
**Data:** SQL + NoSQL databases, caching, streaming systems  
**Observability:** Prometheus, Grafana, OpenTelemetry (or similar)

## What You'll Need to Be Successful

### Core Engineering
- 5+ years of Backend or Infrastructure Engineering experience
- Expert-level proficiency in Golang (**must-have**, heavy hands-on)
- Strong experience building production-grade distributed systems
- Proven track record on infrastructure platforms, PaaS, or deep-tech systems

### Infrastructure & Systems
- Deep understanding of cloud-native architectures and containerized environments
- Strong experience with **Kubernetes**, **Docker**, and cluster orchestration
- Familiarity with compute scheduling, resource management, or platform runtimes is a strong plus

### Databases & Data Systems
- Experience with distributed databases (**PostgreSQL**, **Cassandra**, **DynamoDB**, etc.)
- Strong understanding of caching, queues, and streaming systems (**Redis**, **Kafka**, etc.)

### AI / Platform Exposure (Highly Preferred)
- Experience on AI/ML platforms, model infrastructure, or data platforms
- Familiarity with ML pipelines, inference systems, or GPU-backed workloads
- Exposure to **PyTorch**, **TensorFlow** infrastructure, or model serving systems is a plus

## Similar roles

- [Senior Software Engineer](https://hotfix.jobs/jobs/275900f2-82a9-44e7-a2bc-1a62d449ec97) - Clickhouse - Remote - $141k – $238k/yr
- [Senior Software Engineer, Backend](https://hotfix.jobs/jobs/d19a9ae5-b1cd-40fe-afff-6dcc58bb0c2d) - Payabli - Remote
- [Senior Backend Engineer](https://hotfix.jobs/jobs/4b7e2c83-fc89-4cec-bff5-78a5c1cfc2d7) - Aurelian - Seattle, WA - $160k – $220k/yr
- [Senior Software Engineer, Backend](https://hotfix.jobs/jobs/aae445f1-8e62-4e47-8923-15cf530d3bb7) - Vector Legal - Remote - $180k – $200k/yr
- [Software Engineer, Backend](https://hotfix.jobs/jobs/542f1aa3-f562-44e7-a8de-caf3d127868d) - Mercor - San Francisco, CA - $200k – $500k/yr

**Apply:** https://hotfix.jobs/jobs/edbb8d5b-077e-4aea-b0e2-32fdd50d24ba
**Canonical:** https://hotfix.jobs/jobs/edbb8d5b-077e-4aea-b0e2-32fdd50d24ba