AI Gateway Software Engineer II — Scale LLM APIs

Kong; Perugia; On-site; EUR 60,000 - 90,000; Full time

Benefits offered by this job

Equity

Bonus

Health insurance

Dental insurance

Vision insurance

Paid holidays

PTO

Job summary

Kong is seeking a Software Engineer 2 for the AI Gateway in Perugia, Italy, to help build and evolve our API management stack for AI/LLM workloads. You will implement features like proxying, load balancing, and platform integrations on a globally distributed team.

You should have 3+ years of server-side programming experience, strong Golang or Rust skills, and a track record of building scalable, low-latency systems.

Qualifications

• 3+ years of server-side programming experience.
• Hands-on experience with Golang or Rust.
• Proven ability to build and debug highly scalable, distributed systems.
• Strong Linux systems troubleshooting and profiling skills.
• Experience with distributed systems and Linux networking on L7/L4.
• Comfortable working in a globally distributed team.
• Strong ownership and communication skills (documentation written by engineers).
• Familiarity with AI/LLM concepts.

Responsibilities

• Build and maintain API management software for AI/LLM stacks.
• Develop features such as proxying, load balancing, and database support for Kong AI Gateway.
• Troubleshoot bugs, tune performance, and perform low-level optimizations.
• Bridge Kong with third-party deployment platforms and tooling.
• Handle additional tasks as assigned by management.

Skills

Server-side programming

Golang

Rust

Distributed systems

Linux troubleshooting

Linux networking

Profiling

Team collaboration

Ownership

AI/LLM concepts

Documentation

Global teams

Tools

Golang

Rust

Job description

Kong is seeking a Software Engineer 2 for the AI Gateway in Perugia, Italy, to help build and evolve our API management stack for AI/LLM workloads. You will implement features like proxying, load balancing, and platform integrations on a globally distributed team.

You should have 3+ years of server-side programming experience, strong Golang or Rust skills, and a track record of building scalable, low-latency systems.