Latest AI JobsBrowse Jobs
Kong logo

Software Engineer AI Gateway

KongMilan, ItalyAll Cost Center
Apply on company site
Salary
Not listed
Job type
Full-time
Work mode
Remote
Posted
17 Jun 2026
Status
Open · checked 7d ago

About this role

Kong is seeking a Software Engineer for its AI Gateway team to help organizations govern their artificial intelligence and large language model innovations. This remote position is based out of Milan, Italy, and suits software professionals with backend experience who want to shape the future of AI connectivity.

Role Overview

In this position, team members build and support the Kong AI Gateway platform, enabling developers worldwide to manage AI workflows. Responsibilities center on developing core functionalities like semantic routing, multi-LLM load balancing, and model context protocols. Candidates collaborate with a distributed group of engineers to deliver high-performance API management solutions.

Key Responsibilities

Design, construct, and maintain specialized API management tools and underlying technical stacks for AI and LLMs.
Deliver innovative features such as advanced proxying capabilities, database support, and load balancing mechanisms.
Investigate bugs, resolve issues, optimize performance, and execute low-level system enhancements.
Bridge integration gaps between the platform and third-party tooling or deployment environments.
Write clear technical documentation for developed products and features.

Requirements

Three or more years of professional programming background in server-side application development.
Practical, hands-on coding expertise using either Rust or Golang.
Track record of building, scaling, and debugging resilient, distributed systems.
Deep technical knowledge in Linux systems troubleshooting, profiling, and networking stacks.
Familiarity with computer systems programming and L4/L7 transport protocols.
Ability to thrive in a remotely distributed team environment alongside strong written communication skills.

Nice to Have

Direct working experience with NGINX, LuaJIT, OpenResty, or Kong technologies.
Previous background utilizing Istio or Envoy service mesh solutions.

Skills and Tools

Golang
Rust
LLM concepts
Linux systems
Distributed systems
L4 and L7 networking protocols

About the Company

Kong Inc. operates as the AI connectivity company, constructing the unified connectivity layer for artificial intelligence. Fortune 500 enterprises and AI startups rely on the platform to secure, accelerate, and govern data flow across multiple clouds and models.

How to Apply

Interested candidates should visit the official Kong careers page to submit an application for this opportunity.

Skills and tech stack

GolangRustLLM

Questions candidates ask

Is this position remote?

Yes, this role is remotely distributed, with a listed location in Milan, Italy.

What programming languages are required?

Applicants must have hands-on coding experience with either Golang or Rust.

How many years of experience are needed?

The position requires three or more years of programming background in server-side components.

What core technologies does the AI Gateway team work on?

The team works on multi-LLM routing, semantic caching, proxying, load balancing, and API management for AI.

Are there any preferred bonus skills for this job?

Bonus points are given to candidates with experience in Envoy, Istio, NGINX, OpenResty, LuaJIT, or Kong.

Ready to apply?

The application is on the official Kong careers page.

Apply on company site