Software Engineer, AI Gateway

Kong; Turbigo; Remoto; EUR 70.000 - 120.000; Tempo pieno

Descrizione del lavoro

Kong is hiring a Software Engineer for the AI Gateway Team to help build and scale API management for AI/LLM workloads, focusing on multi-LLM routing and semantic caching. You will join a globally distributed engineering crew and implement features, troubleshoot issues, and optimize performance.

You'll contribute to low-level programming in Golang or Rust, work on Linux-based systems, and help extend Kong's AI platform with robust, scalable solutions. Remote collaboration is expected.

Competenze

• 3+ years of server-side programming experience.
• Hands-on experience with Golang or Rust.
• Experience building scalable, distributed systems.
• Low-level Linux troubleshooting and profiling.
• APIs on L7/L4 transports and protocols experience.
• Comfortable working with a distributed remote team.
• Strong ownership and documentation skills.
• Familiarity with AI/LLM concepts.

Mansioni

• Build and maintain API management software for AI/LLM workloads.
• Implement features including proxying, load balancing, and database support.
• Troubleshoot bugs, tune performance, and optimize at low level.
• Bridge Kong with deployment platforms and tooling.
• Perform any tasks needed by the manager.

Conoscenze

Golang

Rust

Distributed systems

Linux networking

Performance tuning

API management

Documentation

Remote collaboration

Strumenti

NGINX/OpenResty

LuaJIT

Envoy

Istio

Descrizione del lavoro

About the Role:

You will join the engineering team that builds the Kong AI gateway, empowering companies and developers around the world to govern every step of their AI & LLM based innovation.

As a Software Engineer in the AI Gateway Team, you will be working on core features such as multi-LLM routing and balancing, semantic caching and routing, MCP, and more.

What You'll Do:

• Responsible for building and maintaining API management software for AI and LLMs and its underlying stack.

• Implement new innovative features including proxying capabilities, load balancing, databases support that extend Kong AI Gateway’s offering.

• Bugs troubleshooting, performance tuning and low-level optimizations.

• Fill the gaps between Kong and third-party deployment platforms and tooling.

• Any additional tasks required by manager.

What You'll Bring:

• 3+ years of programming in server-side applications and components.

• Hands on experience with either Golang or Rust

• Experience building and debugging applications that are highly scalable, distributed, reliable and resilient.

• Solid hands-on low-level technical expertise in Linux systems troubleshooting, and profiling.

• Experience in distributed systems, Linux networking stack and computer systems programming, Kong works with APIs on both L7 and L4 transports and protocols, so this expertise and knowledge are required.

• Comfortable working with a remotely distributed team.

• Strong sense of ownership and excellent verbal and written communication skills -- engineers at Kong write the documentation for their products

• Familiarity with AI LLM concepts and applications development

Bonus Points:

• Hands on experience with NGINX/OpenResty/Kong/LuaJIT.

• Hands on experience with Envoy or Istio.

#LI-EA1

About Kong:

Kong Inc., the AI Connectivity Company, is building the connectivity layer of AI. Trusted by the Fortune 500® and AI-native startups alike, Kong’s unified API and AI platform enables organizations to secure, manage, accelerate, govern, and monetize the flow of intelligence across APIs and AI traffic — on any model, any cloud. For more information, visit www.konghq.com.