# Software Engineer AI Gateway

**Company:** [Kong](https://hotfix.jobs/companies/kong)
**Location:** Milan, Italy
**Role:** Backend Engineering
**Experience:** 3+ years
**Skills:** Go, Rust, Linux, Distributed Systems, Linux Networking, Computer Systems Programming, Api Management, Load Balancing, Nginx, Openresty, Kong, Luajit, Envoy, Istio, Llm Applications
**Posted:** 2026-06-17

> Build and maintain distributed server-side software for Kong’s AI Gateway, including LLM routing, proxying, load balancing, and semantic caching. The role requires 3+ years of server-side programming experience, Go or Rust expertise, strong Linux and networking skills, and familiarity with AI/LLM applications.

## Job Description

## Responsibilities
- Build and maintain API management software for AI and large language models (LLMs) and its underlying stack.
- Implement features including proxying capabilities, load balancing, and database support for the Kong AI Gateway.
- Troubleshoot bugs, tune performance, and perform low-level optimizations.
- Integrate Kong with third-party deployment platforms and tooling.
- Work on multi-LLM routing and balancing, semantic caching and routing, MCP, and related AI Gateway capabilities.
- Complete additional tasks assigned by the manager.

## Requirements
- 3+ years of programming experience with server-side applications and components.
- Hands-on experience with Go or Rust.
- Experience building and debugging highly scalable, distributed, reliable, and resilient applications.
- Strong low-level technical expertise in Linux systems troubleshooting and profiling.
- Experience with distributed systems, the Linux networking stack, and computer systems programming.
- Knowledge of APIs across L7 and L4 transports and protocols.
- Familiarity with AI/LLM concepts and application development.
- Comfortable working with a remotely distributed team.
- Strong sense of ownership and excellent verbal and written communication skills.
- Ability to write product documentation.

## Nice-to-haves
- Hands-on experience with NGINX, OpenResty, Kong, or LuaJIT.
- Hands-on experience with Envoy or Istio.

## Similar jobs

- [Software Engineer - Wallets](https://hotfix.jobs/jobs/32955ac3-4c1c-4a94-83a2-7e6f18965180) - Rain - Remote - $220k – $270k/yr
- [Software Engineer - Branching](https://hotfix.jobs/jobs/e74343fa-f4f1-4737-8d28-ddcadd6feb92) - Supabase - Remote
- [Software Engineer II - Global Football & Rugby](https://hotfix.jobs/jobs/89a42316-e766-4f7f-971a-32468cd07a9e) - Hudl - Chiavari, Italy - €34k – €57k/yr
- [Senior Software Engineer, Backend (Money Movement)](https://hotfix.jobs/jobs/8afb425b-fe94-4b6b-8b26-f8dde0de4f58) - Phantom - Remote
- [Senior Backend Engineer, Core APIs](https://hotfix.jobs/jobs/81121cc0-579a-4c8d-ae6f-accddd1b2195) - Fingerprint - Remote - $150k – $200k/yr

**Apply:** https://hotfix.jobs/jobs/a9d36b09-f1e3-4d9c-bb2c-f64034c5a1df
**Canonical:** https://hotfix.jobs/jobs/a9d36b09-f1e3-4d9c-bb2c-f64034c5a1df