# AI Engineer, AIOps & Infrastructure

**Company:** [Eloquent AI](https://hotfix.jobs/companies/eloquent-ai)
**Location:** San Francisco, CA
**Role:** DevOps / SRE
**Experience:** 5+ years
**Skills:** Kubernetes, Python, AWS, GCP, Azure, MLOps, Llmops, Gpu Optimization, Ml Model Deployment, Vector Databases
**Posted:** 2025-08-22

> Designs and builds scalable AI infrastructure for deploying enterprise AI agents, automates LLMOps/MLOps workflows, optimizes GPU workloads, and ensures production reliability using Kubernetes and cloud platforms. Requires 5+ years in MLOps/infrastructure and deep expertise in Python and distributed systems.

## Job Description

## Responsibilities
- Design and build scalable ML infrastructure for deploying and maintaining AI agents in production.
- Automate LLMOps and MLOps workflows, ensuring seamless model training, fine-tuning, deployment, and monitoring.
- Optimize GPU and cloud compute workloads, improving efficiency and reducing latency for large-scale AI systems.
- Develop Kubernetes-based solutions, including custom operators for ML model orchestration.
- Improve system observability and reliability, implementing logging, monitoring, and performance tracking for AI models.
- Work with ML and engineering teams to streamline data pipelines, model serving, and inference optimizations.
- Ensure security, compliance, and reliability in AI infrastructure, maintaining high availability and scalability.
- Participate in on-call rotations, ensuring 24/7 reliability of critical AI systems.

## Requirements
- **5+ years** of experience in software engineering, MLOps, or infrastructure development.
- Strong expertise in **Kubernetes** and experience managing containerized ML workloads.
- Deep understanding of cloud platforms (**AWS**, **GCP**, **Azure**) and distributed computing.
- Proficiency in **Python**, with experience developing services for ML/AI applications.
- Experience with ML model deployment pipelines, including model serving, inference optimization, and monitoring.
- Familiarity with vector databases, retrieval systems, and RAG architectures is a plus.
- Strong problem-solving skills and the ability to work in a high-scale, production-focused AI environment.

## Nice-to-Haves
- Experience with **LLMOps**, fine-tuning, and deploying large-scale AI models.
- Worked with GPU workload optimization, ML model parallelization, or distributed training strategies.
- Experience building infrastructure for AI-powered applications.
- Contributed to open-source MLOps tools or AI infrastructure projects.
- Thrive in a fast-moving startup environment and enjoy solving complex technical challenges.

## Similar roles

- [Software Engineer, Platform & Infrastructure](https://hotfix.jobs/jobs/2a4d6818-4e00-4a08-8339-aba841ed1ada) - Forus - New York, NY
- [Software Engineer, Developer Productivity](https://hotfix.jobs/jobs/3d3eb78d-cb73-4b62-bef0-6c84085fdf5a) - Forus - New York, NY
- [Site Reliability Engineer](https://hotfix.jobs/jobs/8def48bc-b809-4397-bd55-28b9747c1f82) - Runloop - San Francisco, CA
- [Build & Release Engineer](https://hotfix.jobs/jobs/c41c87c5-6007-46e9-8648-635789c39b4a) - Applied Intuition - Sunnyvale, CA - $118k – $200k/yr
- [Software Engineer, Async Platform](https://hotfix.jobs/jobs/f1db6fa3-5b80-4939-86b0-39e6f0db0694) - Lyft - Seattle, WA - $118k – $147k/yr

**Apply:** https://hotfix.jobs/jobs/45eea9fb-e063-453f-8e0c-9b38e8583062
**Canonical:** https://hotfix.jobs/jobs/45eea9fb-e063-453f-8e0c-9b38e8583062