Senior Software Engineer - AI Gateway
Build and optimize core API gateway and management capabilities, including proxying, load balancing, databases, and integrations. The role requires 5+ years of server-side programming experience, strong Linux and distributed-systems expertise, and familiarity with AI/LLM application development.
About the job
Responsibilities
- Design, build, and maintain API management software and its underlying stack.
- Architect, design, and implement innovative features, including proxying capabilities, load balancing, and database support.
- Troubleshoot bugs, tune performance, and perform low-level optimizations.
- Engage with the open-source community and extend Kong core to support current industry trends.
- Integrate Kong with third-party deployment platforms and tooling.
- Build foundations for other teams and customers.
Requirements
- 5+ years of programming experience in server-side applications and components.
- Experience designing, prototyping, building, and debugging highly scalable, distributed, reliable, and resilient applications.
- Strong hands-on expertise troubleshooting and profiling Linux systems.
- Experience with distributed systems, the Linux networking stack, and computer systems programming.
- Expertise with APIs over L7 and L4 transports and protocols.
- Comfort working with a remotely distributed team.
- Strong sense of ownership and excellent verbal and written communication skills.
- Familiarity with AI and large language model concepts and application development.
Nice-to-haves
- Hands-on experience with NGINX, OpenResty, Kong, or LuaJIT.
- Hands-on experience with Envoy or Istio.
- Hands-on experience with Rust.
Compensation
- Compensation details were not provided.
Skills
Linux, Distributed Systems, Linux Networking, Computer Systems Programming, Api Management, Load Balancing, Database Systems, Nginx, Openresty, Kong, Luajit, Envoy, Istio, Rust, LLMs
Similar jobs
Backend Engineering jobs
Phantom
Remote
Senior backend engineer designing scalable services and APIs that connect Phantom Cash to blockchain networks. The role requires Node.js/NestJS, REST API, event-driven, and distributed-systems expertise, with blockchain or fintech experience preferred.
Fingerprint
Remote
Build and operate highly performant Core API services for real-time fraud detection, owning reliability, observability, scaling, and production operations. The role requires 5+ years of backend experience with Go or Node.js and strong SRE practices.
Vanta
Remote
Build and operate the backend runtime platform that schedules, executes, and persists security and compliance tests at scale. The role requires strong production systems experience, ownership of complex projects, debugging expertise, and effective technical collaboration and mentorship.
Scribe
Remote
Build and operate backend systems for large-scale data ingestion, workflow processing, and AI inference. The role requires 8+ years of backend experience, distributed-systems expertise, and proficiency with Python, TypeScript, or Go in production AWS environments.
Duolingo
Beijing, China
The Senior Software Engineer will build and maintain backend services and infrastructure supporting Duolingo’s monetization products. The role requires strong software design fundamentals, programming experience in Java, Python, or Kotlin, and familiarity with databases and cloud-based APIs.