# Software Engineer, AI Gateway

**Company:** [Vercel](https://hotfix.jobs/companies/vercel)
**Location:** San Francisco, CA, New York, NY
**Role:** ML Engineering
**Salary:** $196k – $294k/yr
**Experience:** 5+ years
**Skills:** JavaScript, TypeScript, Ai/Ml Integrations, Api Gateways, Distributed Systems, Rate Limiting, Caching, Failovers, OpenAI, Anthropic
**Posted:** 2026-02-12

> Develop and enhance the AI Gateway platform, building unified APIs for AI models with rate limiting, failovers, and integrations. Requires 5+ years experience in JavaScript/TypeScript, backend, and distributed systems.

## Job Description

## What You Will Do
- Contribute to the design, implementation, and maintenance of the AI Gateway platform, emphasizing features like unified API endpoints, rate limit management, and intelligent failover mechanisms to boost uptime and reliability.
- Write clean, efficient, and well-documented code, conducting thorough testing to ensure low-latency responses and stability for high-volume AI inference requests.
- Collaborate with cross-functional teams, including product managers, AI researchers, and infrastructure engineers, to integrate new AI providers and models while addressing scalability and performance challenges.
- Engage with the open-source community, contribute to AI SDK and related projects, and align with Vercel's ethos of fostering developer tools.
- Gather user feedback and analytics to drive innovations in AI Gateway, such as enhanced billing unification, provider-agnostic authentication, and analytics for usage insights.

## About You
- You have at least 5+ years of relevant experience
- Strong proficiency in JavaScript/TypeScript and experience with backend development, APIs, and cloud infrastructure
- Experience with AI/ML integrations, API gateways, distributed systems, or handling high-throughput services (e.g., rate limiting, caching, failovers)
- Experience contributing to or participating in open source projects
- Excellent communication skills and the ability to work effectively in a collaborative team environment

## Benefits
- Competitive compensation package, including equity.
- Inclusive Healthcare Package.
- Learn and Grow - we provide mentorship and send you to events that help you build your network and skills.
- Flexible Time Off.
- We will provide you the gear you need to do your role, and a WFH budget for you to outfit your space as needed.

**San Francisco, CA base pay range: $196,000-$294,000.** Actual salary will be based on job-related skills, experience, and location.

## Similar roles

- [Machine Learning Engineer](https://hotfix.jobs/jobs/30653395-ead1-4a08-a111-f974d32115bf) - Otter - Mountain View, CA - $196k – $221k/yr
- [Software Engineer, AI SDK](https://hotfix.jobs/jobs/4abbfd92-3ae7-44a0-bc4b-8f45411c8540) - Vercel - San Francisco, CA - $196k – $294k/yr
- [AI Engineer](https://hotfix.jobs/jobs/3878e969-2b44-46f4-a8bf-9ceba03bdf47) - Eve - San Mateo, CA - $195k – $300k/yr
- [AI Deployment Engineer- Codex](https://hotfix.jobs/jobs/a4a216ee-3cb1-43a4-bee9-b4f7f571ab91) - OpenAI - San Francisco, CA - $197k – $278k/yr
- [Research Engineer](https://hotfix.jobs/jobs/b4d18018-e64d-4828-a8b4-303225328e17) - Console - San Francisco, CA - $200k – $350k/yr

**Apply:** https://hotfix.jobs/jobs/18901f75-c4a9-4960-99b2-e00abd125f94
**Canonical:** https://hotfix.jobs/jobs/18901f75-c4a9-4960-99b2-e00abd125f94