Software Engineer II: AI Gateway & LLM API Stack

Kong; Vicenza; On-site; EUR 55,000 - 85,000; Full time

Benefits offered by this job

Equity

Bonus

Health, dental, and vision insurance

Paid holidays and PTO

Job summary

Kong is seeking a Software Engineer 2 for the AI Gateway team in Vicenza, Veneto, Italy. You will build and evolve the API management stack for AI/LLM workloads, tackling proxying, load balancing, and platform integrations to deliver low-latency, scalable services.

The role requires hands-on systems expertise, strong ownership, and excellent communication in a globally distributed team. Equity, bonus, and comprehensive health benefits are included.

Qualifications

• 3+ years of server-side programming.
• Hands-on experience with Golang or Rust.
• Strong Linux systems troubleshooting and profiling skills.
• Experience with distributed systems and Linux networking on L7/L4.
• Familiarity with AI/LLM concepts.

Responsibilities

• Build and maintain API management software for AI/LLM stacks.
• Develop features such as proxying, load balancing, and database support for Kong AI Gateway.
• Troubleshoot bugs, tune performance, and perform low-level optimizations.
• Bridge Kong with third-party deployment platforms and tooling.
• Handle additional tasks as assigned by management.

Skills

Golang

Rust

Distributed systems

Linux networking

Linux systems programming

Ownership & communication

Job description

Kong is seeking a Software Engineer 2 for the AI Gateway team in Vicenza, Veneto, Italy. You will build and evolve the API management stack for AI/LLM workloads, tackling proxying, load balancing, and platform integrations to deliver low-latency, scalable services.

The role requires hands-on systems expertise, strong ownership, and excellent communication in a globally distributed team. Equity, bonus, and comprehensive health benefits are included.