AI Gateway Engineer — Scale AI/LLM API Stack (Equity + Bonus)

Kong

Belluno

On-site

EUR 60,000 - 90,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Equity
Bonus
Health, dental, and vision insurance
Paid holidays and PTO

Job summary

Kong is hiring a Software Engineer for the AI Gateway to help build and evolve its API management stack for AI and LLM workloads in Belluno, Veneto, Italy. You will shape core features like multi-LLM routing, semantic caching, and high-scale components, collaborating with a distributed team to deliver reliable, low-latency capabilities.

A strong candidate brings hands-on systems expertise, ownership, and proficiency with Golang or Rust.

Qualifications

  • 3+ years of server-side programming experience.
  • Hands-on with Golang or Rust.
  • Proven ability to build scalable, distributed systems.
  • Strong Linux troubleshooting and profiling skills.
  • Experience with distributed systems and Linux networking on L7/L4.
  • Comfortable working in a globally distributed team.

Responsibilities

  • Build and evolve Kong's AI Gateway features for AI/LLM workloads.
  • Develop proxying, load balancing, and database support.
  • Troubleshoot bugs, tune performance, and optimize low-level code.
  • Bridge Kong with third-party deployment platforms.
  • Collaborate with a distributed team and document engineering work.

Skills

Golang
Rust
Distributed systems
Linux systems

Job description

Kong is hiring a Software Engineer for the AI Gateway to help build and evolve its API management stack for AI and LLM workloads in Belluno, Veneto, Italy. You will shape core features like multi-LLM routing, semantic caching, and high-scale components, collaborating with a distributed team to deliver reliable, low-latency capabilities.

A strong candidate brings hands-on systems expertise, ownership, and proficiency with Golang or Rust.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Gateway Software Engineer (Go/Rust) - Equity
AI Gateway Software Engineer (Go/Rust) - Equity

Kong • Trentino-Alto Adige

On-site
EUR 65,000 - 85,000
Equity
Bonus
Health, dental, and vision insurance
+1
AI Gateway Engineer — Equity, Bonus, Scalable LLM API
AI Gateway Engineer — Equity, Bonus, Scalable LLM API

Kong • Italy

On-site
EUR 70,000 - 110,000
Equity
Bonus
Health insurance
+4
AI Gateway Engineer (Golang/Rust) – Equity & Bonus
AI Gateway Engineer (Golang/Rust) – Equity & Bonus

Kong • Sicilia

On-site
EUR 60,000 - 90,000
Equity
Bonus
Health insurance
+3
Software Engineer II: AI Gateway & LLM API Stack
Software Engineer II: AI Gateway & LLM API Stack

Kong • Vicenza

On-site
EUR 55,000 - 85,000
Equity
Bonus
Health, dental, and vision insurance
+1
AI Gateway Engineer - Scalable API & LLM Stack
AI Gateway Engineer - Scalable API & LLM Stack

Kong • Liguria

On-site
EUR 55,000 - 75,000
Equity
Bonus
Health insurance
+3
AI Gateway Systems Engineer (Golang/Rust) - Equity & Bonus
AI Gateway Systems Engineer (Golang/Rust) - Equity & Bonus

Kong • Modena

On-site
EUR 55,000 - 80,000
Equity
Bonus
Health, dental, and vision insurance
+1
AI Gateway Engineer: Scalable API Stack (Golang/Rust)
AI Gateway Engineer: Scalable API Stack (Golang/Rust)

Kong • Toscana

On-site
EUR 55,000 - 75,000
Equity
Bonus
Health, dental, and vision insurance
+1
AI Gateway Engineer: Multi-LLM Routing & Distributed
AI Gateway Engineer: Multi-LLM Routing & Distributed

Kong • Milano

Hybrid
EUR 45,000 - 65,000
Software Engineer, Ai Gateway
Software Engineer, Ai Gateway

Kong • Belluno

On-site
EUR 60,000 - 90,000
Equity
Bonus
Health, dental, and vision insurance
+1
AI Gateway Engineer: Build Scalable LLM API Stack
AI Gateway Engineer: Build Scalable LLM API Stack

Kong • Chieti

On-site
EUR 60,000 - 90,000
Equity
Bonus
Health, dental, and vision insurance
+1