AI Gateway Engineer: Multi-LLM Routing & Distributed

Kong; Milano; Hybrid; EUR 45,000 - 65,000; Full time

Job summary

Kong, based in Milan, is seeking a Software Engineer for their AI Gateway Team. You will focus on building and maintaining API management software, implementing new features, and solving bugs. Ideal candidates have 3+ years in server-side development, familiarity with Golang or Rust, and a strong sense of ownership.

The role involves collaboration with a distributed team, contributing to AI and LLM innovation, and requires excellent technical and communication skills. Bonus points for experience with NGINX or Istio.

Qualifications

• 3+ years of programming experience in server-side applications.
• Hands-on experience with either Golang or Rust.
• Solid technical expertise in Linux systems troubleshooting.

Responsibilities

• Build and maintain API management software for AI and LLMs.
• Implement innovative features for Kong AI Gateway.
• Perform bug troubleshooting and performance tuning.

Skills

Programming in server-side applications

Golang or Rust

Building and debugging scalable applications

Linux systems troubleshooting

Distributed systems experience

Very good communication skills

Tools

NGINX/OpenResty/Kong/LuaJIT

Envoy or Istio

Job description

Kong, based in Milan, is seeking a Software Engineer for their AI Gateway Team. You will focus on building and maintaining API management software, implementing new features, and solving bugs. Ideal candidates have 3+ years in server-side development, familiarity with Golang or Rust, and a strong sense of ownership.

The role involves collaboration with a distributed team, contributing to AI and LLM innovation, and requires excellent technical and communication skills. Bonus points for experience with NGINX or Istio.