Software Engineer 2, Ai Gateway

Kong; Uri; Remote; EUR 60,000 - 90,000; Full time

Job summary

Kong Inc. cerca un Ingegnere Software per il team AI Gateway. sarai parte dell’ingegneria che sviluppa la gateway AI, definendo routing multi-LLM, caching semantico e integrazioni di backend.

Hai almeno 3 anni in sviluppo server-side, esperienza con Go o Rust, sistemi distribuiti e Linux. Lavoro con team distribuiti a livello internazionale; responsabilità inclusa documentazione e ottimizzazione delle prestazioni.

Qualifications

• 3+ anni di esperienza in applicazioni server-side e componenti.
• Esperienza nello sviluppo e debugging di sistemi distribuiti ad alta scalabilità.
• Conoscenza pratica di Linux e profiling.
• Conoscenza di API su trasporti L7 e L4 è preferita.

Responsibilities

• Costruire e mantenere software di gestione API per AI e LLM.
• Implementare nuove funzionalità tra cui proxying e bilanciamento del carico.
• Risoluzione di bug, ottimizzazione delle prestazioni e tuning a basso livello.
• Colmare le lacune tra Kong e piattaforme/strumenti di deployment di terze parti.
• Gestire ulteriori attività richieste dal manager.

Skills

Go or Rust

Distributed systems

Linux troubleshooting

API load-balancing

Documentation writing

AI/LLM awareness

Remote collaboration

Tools

NGINX/OpenResty

LuaJIT

Envoy

Kong API Platform

Job description

Are you ready to unlock intelligence?

È essenziale assicurarsi di soddisfare i requisiti per questo ruolo; la preghiamo di leggere attentamente quanto segue.

About the Role:

You will join the engineering team that builds the Kong AI gateway, empowering companies and developers around the world to govern every step of their AI & LLM based innovation.

As a Software Engineer in the AI Gateway Team, you will be working on core features such as multi-LLM routing and balancing, semantic caching and routing, MCP, and more.

What You’ll Do:

• Responsible for building and maintaining API management software for AI and LLMs and its underlying stack.
• Implement new innovative features including proxying capabilities, load balancing, databases support that extend Kong AI Gateway’s offering.
• Bugs troubleshooting, performance tuning and low-level optimizations.
• Fill the gaps between Kong and third-party deployment platforms and tooling.
• Any additional tasks required by manager.

What You’ll Bring:

• 3+ years of programming in server-side applications and components.
• Hands on experience with either Golang or Rust
• Experience building and debugging applications that are highly scalable, distributed, reliable and resilient.
• Solid hands-on low-level technical expertise in Linux systems troubleshooting, and profiling
• Experience in distributed systems, Linux networking stack and computer systems programming, Kong works with APIs on both L7 and L4 transports and protocols, so this expertise and knowledge are required.
• Comfortable working with a remotely distributed team.
• Strong sense of ownership and excellent verbal and written communication skills – engineers at Kong write the documentation for their products
• Familiarity with AI LLM concepts and applications development

Bonus Points:

• Hands on experience with NGINX/OpenResty/Kong/LuaJIT.
• Hands on experience with Envoy or Istio. xlwpduy

#LI-EA1

About Kong:

Kong Inc., the AI Connectivity Company, is building the connectivity layer of AI. Trusted by the Fortune 500® and AI-native startups alike, Kong’s unified API and AI platform enables organizations to secure, manage, accelerate, govern, and monetize the flow of intelligence across APIs and AI traffic — on any model, any cloud. For more information, visit J-18808-Ljbffr