AI Gateway Engineer: Build Scalable LLM API Stack

Kong

Chieti

On-site

EUR 60,000 - 90,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Equity
Bonus
Health, dental, and vision insurance
Paid holidays and PTO

Job summary

Kong is seeking a Software Engineer 2 for the AI Gateway team in Chieti, Abruzzo, Italy. You will help build and evolve Kong's API management stack for AI and LLM workloads, focusing on multi-LLM routing, semantic caching, and high-scale components.

You’ll work on proxying, load balancing, and platform integrations with a distributed team to deliver reliable, low-latency capabilities. A strong candidate brings hands-on systems expertise, ownership, and excellent communication skills to

Qualifications

  • 3+ years of server-side programming experience.
  • Hands-on experience with Golang or Rust.
  • Proven ability to build and debug highly scalable, distributed systems.
  • Strong Linux systems troubleshooting and profiling skills.
  • Experience with distributed systems and Linux networking on L7/L4.

Responsibilities

  • Build and maintain API management software for AI/LLM stacks.
  • Develop features such as proxying, load balancing, and database support for Kong AI Gateway.
  • Troubleshoot bugs, tune performance, and perform low-level optimizations.
  • Bridge Kong with third-party deployment platforms and tooling.
  • Handle additional tasks as assigned by management.

Skills

Golang
Rust
Linux systems
Distributed systems
Linux networking
Ownership
Communication

Job description

Kong is seeking a Software Engineer 2 for the AI Gateway team in Chieti, Abruzzo, Italy. You will help build and evolve Kong's API management stack for AI and LLM workloads, focusing on multi-LLM routing, semantic caching, and high-scale components.

You’ll work on proxying, load balancing, and platform integrations with a distributed team to deliver reliable, low-latency capabilities. A strong candidate brings hands-on systems expertise, ownership, and excellent communication skills to

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Gateway Engineer - Scalable API & LLM Stack
AI Gateway Engineer - Scalable API & LLM Stack

Kong • Liguria

On-site
EUR 55,000 - 75,000
Equity
Bonus
Health insurance
+3
AI Gateway Engineer — Equity, Bonus, Scalable LLM API
AI Gateway Engineer — Equity, Bonus, Scalable LLM API

Kong • Italy

On-site
EUR 70,000 - 110,000
Equity
Bonus
Health insurance
+4
Software Engineer II: AI Gateway & LLM API Stack
Software Engineer II: AI Gateway & LLM API Stack

Kong • Vicenza

On-site
EUR 55,000 - 85,000
Equity
Bonus
Health, dental, and vision insurance
+1
AI Gateway Engineer — Scale AI/LLM API Stack (Equity + Bonus)
AI Gateway Engineer — Scale AI/LLM API Stack (Equity + Bonus)

Kong • Belluno

On-site
EUR 60,000 - 90,000
Equity
Bonus
Health, dental, and vision insurance
+1
AI Gateway Software Engineer (Go/Rust) - Equity
AI Gateway Software Engineer (Go/Rust) - Equity

Kong • Trentino-Alto Adige

On-site
EUR 65,000 - 85,000
Equity
Bonus
Health, dental, and vision insurance
+1
AI Gateway Engineer (Golang/Rust) – Equity & Bonus
AI Gateway Engineer (Golang/Rust) – Equity & Bonus

Kong • Sicilia

On-site
EUR 60,000 - 90,000
Equity
Bonus
Health insurance
+3
AI Gateway Engineer: Scalable API for LLMs
AI Gateway Engineer: Scalable API for LLMs

Kong • Toscana

On-site
EUR 55,000 - 90,000
Equity
Bonus
Health, dental, and vision insurance
+1
AI Gateway Engineer: Scalable API & LLM Routing
AI Gateway Engineer: Scalable API & LLM Routing

Kong • Turbigo

Remote
EUR 70,000 - 120,000
AI Gateway Engineer: Scalable API Stack (Golang/Rust)
AI Gateway Engineer: Scalable API Stack (Golang/Rust)

Kong • Toscana

On-site
EUR 55,000 - 75,000
Equity
Bonus
Health, dental, and vision insurance
+1
Software Engineer 2, Ai Gateway
Software Engineer 2, Ai Gateway

Kong • Chieti

On-site
EUR 60,000 - 90,000
Equity
Bonus
Health, dental, and vision insurance
+1