Senior AI Gateway Engineer - Golang/Python, Kubernetes

Kong; Milan (MI); On-site; USD 140,000 - 190,000; Full time

Job summary

Kong Inc. is seeking a senior backend-focused engineer to help build the AI Gateway in a Kubernetes-based, cloud-native environment. You will own core components, write clean Go and/or Python, and promote high availability and low latency for AI traffic at scale.

You will shape the architecture, mentor engineers, and collaborate with product teams to translate complex customer requirements into scalable solutions, embracing Kong's Developer Delight ethos.

Qualifications

• Experience building backend systems for scalable services.
• Strong knowledge of Go and/or Python.
• Familiarity with cloud-native environments (Kubernetes, Docker, AWS/GCP/Azure).
• Knowledge of API gateways, service meshes, and related infra.

Responsibilities

• Design and own core components of the AI Gateway with 99.99% uptime and low latency.
• Implement features like prompt engineering, caching, and observability in Go and/or Python.
• Influence the technical roadmap and manage debt for long-term scalability.
• Architect integrations with various LLMs and AI platforms for API management.
• Mentor junior engineers through code reviews and design discussions.
• Drive the full development lifecycle in a Kubernetes environment from ideation to deployment.
• Collaborate with product managers to translate customer needs into robust technical solutions.

Skills

Distributed systems

Microservices

API design

Go

Python

Tools

Kubernetes

Docker

AWS/GCP/Azure

Job description

Kong Inc. is seeking a senior backend-focused engineer to help build the AI Gateway in a Kubernetes-based, cloud-native environment. You will own core components, write clean Go and/or Python, and promote high availability and low latency for AI traffic at scale.

You will shape the architecture, mentor engineers, and collaborate with product teams to translate complex customer requirements into scalable solutions, embracing Kong's Developer Delight ethos.