Latest AI JobsBrowse Jobs
Kong logo

Software Engineer - AI Gateway

KongShanghai, ChinaAll Cost Center
Apply on company site
Salary
Not listed
Job type
Full-time
Posted
23 Jul 2026
Status
Open · checked 7d ago

About this role

Kong seeks a Software Engineer - AI Gateway in Shanghai to build advanced core features for globally adopted open-source technology. This full-time position suits experienced developers with a background in server-side systems, distributed architecture, and a familiarity with modern artificial intelligence concepts.

Role Overview

As a Systems Engineer in the Core Team, the professional focuses on forward-thinking foundational infrastructure like load balancing, database support, and proxying capabilities. The contributor works on building scalable foundations that support various deployment platforms, internal teams, and end users.

Key Responsibilities

Design, build, and maintain sophisticated API management software and its associated stack.
Architect and implement innovative features that expand the core offerings of the platform.
Troubleshoot bugs, tune performance, and perform low-level system optimizations.
Engage actively with the open-source community to align the core product with modern technology trends.
Integrate the platform smoothly with third-party deployment tools and external platforms.
Document created features and handle additional tasks assigned by management.

Requirements

Minimum of five years of professional server-side application and component programming experience.
Proven background in designing, prototyping, building, and debugging resilient, distributed, and scalable applications.
Strong practical expertise in low-level Linux system profiling and troubleshooting.
Working knowledge of distributed systems, the Linux networking stack, and computer systems programming, specifically concerning L4 and L7 protocols and transports.
Ability to work effectively within a remotely distributed team environment.
High sense of ownership and strong written and verbal communication skills for documentation.
Familiarity with large language model concepts and modern application development.

Nice to Have

Practical experience working with NGINX, OpenResty, Kong, or LuaJIT.
Background utilizing Envoy or Istio.
Hands-on coding experience with Rust.

Skills and Tools

Rust
LLMs
Linux systems
Distributed systems
L4 and L7 networking protocols

About the Company

Kong Inc., known as the AI Connectivity Company, creates the connectivity layer for artificial intelligence. Serving Fortune 500 enterprises and AI startups, the unified platform helps organizations secure, manage, accelerate, govern, and monetize intelligence flow across APIs and AI traffic for any model or cloud.

How to Apply

Interested candidates should visit the official Kong careers page to submit their application.

Skills and tech stack

RustLLM

Questions candidates ask

Where is this job located?

This position is based in Shanghai, China.

What level of experience is required?

Candidates must have five or more years of programming experience in server-side applications and components.

Is remote work supported?

While the location is Shanghai, the employee will collaborate comfortably with a remotely distributed team.

What technical skills are highlighted as nice to have?

Bonus points are given for practical experience with Rust, Envoy, Istio, NGINX, OpenResty, Kong, or LuaJIT.

How do I apply for the position?

Applicants should apply directly on the official company careers website.

Ready to apply?

The application is on the official Kong careers page.

Apply on company site