Senior AI Gateway Engineer — Build Scalable AI APIs

Kong

Lombardia

On-site

EUR 90,000 - 140,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Kong Inc., the AI Connectivity Company, is building the connectivity layer of AI. We are seeking a senior backend engineer to design and own core components of our AI Gateway, ensuring 99.99% uptime and low-latency AI traffic handling.

You will implement features like prompt engineering, caching, and observability in Golang and/or Python, influence architecture, and collaborate with a distributed team across cloud environments. Mentoring and full lifecycle ownership are key aspects of the role.

Qualifications

  • 5+ years of backend development experience (Golang or Python).
  • Experience with AI/ML infra and LLMs.
  • Strong foundations in distributed systems and API design.
  • Cloud-native experience (Kubernetes, Docker, AWS/GCP/Azure).
  • Familiarity with API gateways or service mesh is a plus.

Responsibilities

  • Design and own core components of the AI Gateway ensuring high uptime and low latency for critical AI traffic.
  • Lead implementation of features like prompt engineering, caching, and observability in Golang/Python.
  • Influence technical roadmap and mitigate debt to enable long-term scalability.
  • Architect integrations with various LLMs and AI platforms for API management.
  • Mentor junior engineers and participate in design reviews.

Skills

Golang
Python
LangChain
LlamaIndex
Distributed systems
API design
Cloud-native

Tools

Kubernetes
Docker
AWS/Azure/GCP

Job description

Kong Inc., the AI Connectivity Company, is building the connectivity layer of AI. We are seeking a senior backend engineer to design and own core components of our AI Gateway, ensuring 99.99% uptime and low-latency AI traffic handling.

You will implement features like prompt engineering, caching, and observability in Golang and/or Python, influence architecture, and collaborate with a distributed team across cloud environments. Mentoring and full lifecycle ownership are key aspects of the role.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Gateway Engineer - Build Scalable APIs & LLMs
AI Gateway Engineer - Build Scalable APIs & LLMs

Kong • Lombardia

Remote
EUR 65,000 - 110,000
Senior Software Engineer, AI Gateway
Senior Software Engineer, AI Gateway

Kong • Lombardia

On-site
EUR 90,000 - 140,000
AI Gateway Engineer: Scalable API & LLM Routing
AI Gateway Engineer: Scalable API & LLM Routing

Kong • Turbigo

Remote
EUR 70,000 - 120,000
Software Engineer AI Gateway
Software Engineer AI Gateway

Kong • Lombardia

Remote
EUR 65,000 - 110,000
AI Gateway Engineer - Scalable API & LLM Stack
AI Gateway Engineer - Scalable API & LLM Stack

Kong • Liguria

On-site
EUR 55,000 - 75,000
Equity
Bonus
Health insurance
+3
Senior Security Champion - AI & API Gateway Engineer
Senior Security Champion - AI & API Gateway Engineer

kong • Italy

Hybrid
EUR 60,000 - 90,000
Hybrid work from Milan hub
Bonus and welfare system
AI Gateway Engineer: Scalable API for LLMs
AI Gateway Engineer: Scalable API for LLMs

Kong • Toscana

On-site
EUR 55,000 - 90,000
Equity
Bonus
Health, dental, and vision insurance
+1
Software Engineer 2, AI Gateway
Software Engineer 2, AI Gateway

Kong • Milano

Remote
EUR 65,000 - 90,000
Software Engineer, Ai Gateway
Software Engineer, Ai Gateway

Kong • Liguria

On-site
EUR 55,000 - 75,000
Equity
Bonus
Health insurance
+3
Software Engineer, Ai Gateway
Software Engineer, Ai Gateway

Kong • Toscana

On-site
EUR 55,000 - 90,000
Equity
Bonus
Health, dental, and vision insurance
+1