Remote AI Gateway Backend Engineer (Golang/Rust)

KONG; Lombardia; On-site; EUR 55,000 - 90,000; Full time

Job summary

Kong Inc. is seeking a Software Engineer for the AI Gateway team in a role focused on building API management software for AI and LLMs. You will work on multi-LLM routing, semantic caching, and performance optimizations in a distributed system environment.

Your work will bridge Kong with deployment platforms, requiring strong Linux skills and hands-on experience with Go or Rust. Remote-friendly collaboration is encouraged.

Qualifications

• 3+ years of server-side programming experience.
• Hands-on with Golang or Rust in scalable, distributed systems.
• Strong Linux troubleshooting and profiling skills.
• Experience building and debugging API-centric software.

Responsibilities

• Build and maintain API management software for AI and LLMs.
• Implement features like proxying, load balancing, and DB support.
• Troubleshoot, optimize performance, and harden low-level code.
• Collaborate with distributed teams and document work.

Skills

Golang

Rust

Distributed systems

Linux troubleshooting

APIs development

Tools

NGINX

OpenResty

LuaJIT

Envoy

Job description

Kong Inc. is seeking a Software Engineer for the AI Gateway team in a role focused on building API management software for AI and LLMs. You will work on multi-LLM routing, semantic caching, and performance optimizations in a distributed system environment.

Your work will bridge Kong with deployment platforms, requiring strong Linux skills and hands-on experience with Go or Rust. Remote-friendly collaboration is encouraged.