# Staff Software Engineer - AI Platform Team

**Company:** [Coinbase](https://hotfix.jobs/companies/coinbase)
**Location:** Remote
**Role:** ML Engineering
**Experience:** 7+ years
**Skills:** LLMs, Machine Learning, Python, Kubernetes, Docker, AWS, Vector Databases, API Development, Observability, Fine-Tuning
**Posted:** 2026-06-24

> Staff-level engineer building and operating Coinbase's LLM/agent infrastructure including gateway, runtime, knowledge bases, and applied AI agents. Own multi-quarter platform initiatives and partner with frontier labs.

## Job Description

## What you'll do

- LLM Gateway: one API for 60+ models across all major providers, including self hosted open weight models, with auth, PII redaction, quotas, fallbacks, and cost optimization
- AI Hub: single front door for agents, skills, MCP servers, knowledge bases, models, memories, and keys
- Agent and MCP runtime: microVM sandboxes per agent run, a governed MCP gateway over 125+ servers, cross trust agent identity, tier 1 agents for code, analytics, and exec personas
- Knowledge Bases: connect any data source, auto provision vector and markdown stores, queryable by any agent over MCP
- AI Spend Hub: FinOps for AI, spend attribution and governance across the company
- Evaluation and observability: in house LLM as judge harness with full tracing and eval tooling
- Company wide chat and low code workflow surfaces, thousands of weekly actives each
- Applied AI: embed with teams to build production agents, build the feedback loops that let subject matter experts refine them, and apply traditional ML including fine tuning where it beats prompting
- Utilize and build generative AI responsibly, maintaining human oversight to deliver business-ready outputs and drive measurable improvements in workflow efficiency, cost, and quality

## Required Skills and Experience

- Own multi quarter, high impact initiatives on the platform (gateway, runtime, knowledge, governance) or the applied agents on top
- Partner across engineering, security, legal, finance, and product
- Work directly with partners at the frontier labs and major cloud providers

## Similar roles

- [Member of Technical Staff](https://hotfix.jobs/jobs/dd7c8bc4-741a-45d5-91a8-e6b1c4ad67e0) - xAI - Palo Alto, CA - $180k – $440k/yr
- [Staff Software Engineer, AI & App Experience](https://hotfix.jobs/jobs/78128221-8199-41cd-9c63-502d3f61d603) - Chime - New York, NY - $223k – $308k/yr
- [Staff + Senior Software Engineer, Cloud Inference Launch Engineering](https://hotfix.jobs/jobs/18b08a6a-5359-4836-b72e-c641fa718b04) - Anthropic - San Francisco, CA - $320k – $485k/yr
- [Senior Staff Software Engineer, Legal Automation](https://hotfix.jobs/jobs/7870d3e1-ebec-4f7b-9ae5-c62926a06d6e) - Coinbase - Remote - $254k – $299k/yr
- [Staff Machine Learning Engineer, Computer Vision](https://hotfix.jobs/jobs/2969c5c0-8479-43bb-b9b6-f8df93b528d7) - Pinterest - San Francisco, CA - $189k – $390k/yr

**Apply:** https://hotfix.jobs/jobs/55b9567f-00a0-485f-9034-62cf16bf5677
**Canonical:** https://hotfix.jobs/jobs/55b9567f-00a0-485f-9034-62cf16bf5677