# Senior Software Engineer - AI Platform Team

**Company:** [Coinbase](https://hotfix.jobs/companies/coinbase)
**Location:** Remote
**Role:** ML Engineering
**Salary:** $186k – $219k/yr
**Experience:** 5+ years
**Skills:** Python, Go, Rust, C++, Llm Gateway, Llm Orchestration, Agent Frameworks, Vector Databases, Model Serving, Knowledge Bases, Microvm Sandboxes, Observability Tooling, Fine-Tuning, Distributed Systems
**Posted:** 2026-07-13

> Senior Software Engineer building and operating Coinbase's central LLM and AI agent platform infrastructure. Owns LLM Gateway, knowledge bases, agent runtime, FinOps, evaluation tooling, and cross-team applied AI strategy. Requires 5+ years building ML/AI infrastructure at scale.

## Job Description

## What you'll do

- Own the architecture and delivery of core platform systems including the LLM Gateway (60+ models, auth, PII redaction, fallbacks, cost optimization), AI Hub, and agent runtime with microVM sandboxes and governed MCP gateway
- Drive the design and implementation of Knowledge Base infrastructure, connecting data sources to auto-provisioned vector and markdown stores queryable by any agent
- Lead AI FinOps capabilities including spend attribution, governance, and cost optimization across all AI workloads company-wide
- Partner across engineering, security, legal, finance, product, and external partners at frontier labs and major cloud providers to ship high-impact platform capabilities
- Build evaluation and observability tooling including LLM-as-judge harnesses, full tracing, and feedback loops that let subject matter experts refine production agents
- Shape applied AI strategy by embedding with teams to build production agents, applying fine-tuning and traditional ML where it outperforms prompting

## Required Skills and Experience

- 5+ years of software engineering experience with demonstrated expertise building ML/AI infrastructure, LLM systems, or distributed platform services at scale
- Demonstrated ability to lead multi-quarter initiatives end-to-end, from technical design through production operation, with measurable platform-wide impact
- Deep expertise in LLM orchestration patterns, agent frameworks, vector databases, and model serving infrastructure across multiple providers
- Proven track record of cross-functional partnership with security, legal, and product teams to ship governed, production-grade AI systems
- Fluency in Python and at least one systems language (Go, Rust, or C++), with production experience building APIs, microservices, and runtime environments
- Utilizes generative AI responsibly, maintaining human oversight to deliver business-ready outputs and drive measurable improvements in workflow efficiency, cost, and quality.

## Similar roles

- [Senior Software Engineer - AI Code Gen - Agent Engineer](https://hotfix.jobs/jobs/29a07c60-76fb-45d5-bb91-449a9b2ff20d) - Datadog - New York, NY - $187k – $240k/yr
- [Senior AI Engineer - APM Experiences](https://hotfix.jobs/jobs/b1e83c7d-5af6-4fd9-ad94-af60f435f81a) - Datadog - New York, NY - $187k – $240k/yr
- [Sr Software Engineer, Cribl AI](https://hotfix.jobs/jobs/db813bb7-e0aa-4356-accd-71a930299507) - Cribl - Remote - $185k – $215k/yr
- [Sr Machine Learning Engineer, AI Research](https://hotfix.jobs/jobs/dd21fdef-4c0a-480d-916f-128ec97de545) - Cribl - Remote - $185k – $215k/yr
- [Senior Machine Learning Engineer - Scene Understanding](https://hotfix.jobs/jobs/b97a5d06-e2a8-4276-bb59-e56092a0a769) - Zoox - Foster City, CA - $189k – $290k/yr

**Apply:** https://hotfix.jobs/jobs/24cb8d81-486e-4cf5-b3fe-a940677eeced
**Canonical:** https://hotfix.jobs/jobs/24cb8d81-486e-4cf5-b3fe-a940677eeced