AI Gateway Engineer - Build Scalable APIs & LLMs

Kong

Lombardia

Remote

EUR 65,000 - 110,000

Full time

3 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Kong is seeking a backend engineer to join the team building the Kong AI gateway, enabling worldwide developers to govern AI and LLM-based innovations. You will build and maintain API management components, implement new features, and optimize performance for highly scalable, distributed systems.

The role requires 3+ years of server-side experience, proficiency in Golang or Rust, strong Linux skills, and a drive to own and document your work.

Qualifications

  • 3+ years of programming in server-side applications and components.
  • Hands on experience with either Golang or Rust.
  • Experience building and debugging applications that are highly scalable, distributed, reliable and resilient.
  • Solid hands-on low-level technical expertise in Linux systems troubleshooting, and profiling.
  • Experience in distributed systems, Linux networking stack and computer systems programming.
  • Comfortable working with a remotely distributed team.
  • Strong sense of ownership and excellent verbal and written communication skills -- engineers at Kong write the documentation for their products.
  • Familiarity with AI LLM concepts and applications development.

Responsibilities

  • Responsible for building and maintaining API management software for AI and LLMs and its underlying stack.
  • Implement new innovative features including proxying capabilities, load balancing, databases support that extend Kong AI Gateway’s offering.
  • Bugs troubleshooting, performance tuning and low-level optimizations.
  • Fill the gaps between Kong and third-party deployment platforms and tooling.
  • Any additional tasks required by manager.

Skills

3+ years server-side programming
Golang
Rust
distributed systems
Linux troubleshooting
low-level optimization
APIs (L7/L4)
remote collaboration
documentation writing
AI/LLM concepts

Tools

NGINX/OpenResty/Kong/LuaJIT
Envoy

Job description

Kong is seeking a backend engineer to join the team building the Kong AI gateway, enabling worldwide developers to govern AI and LLM-based innovations. You will build and maintain API management components, implement new features, and optimize performance for highly scalable, distributed systems.

The role requires 3+ years of server-side experience, proficiency in Golang or Rust, strong Linux skills, and a drive to own and document your work.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Gateway Engineer: Scale LLM APIs (Golang/Rust)
AI Gateway Engineer: Scale LLM APIs (Golang/Rust)

Kong • Lecce

On-site
EUR 45,000 - 65,000
Equity
Bonus
Health insurance
+4
AI Gateway Engineer: Scalable API Stack (Golang/Rust)
AI Gateway Engineer: Scalable API Stack (Golang/Rust)

Kong • Toscana

On-site
EUR 55,000 - 75,000
Equity
Bonus
Health, dental, and vision insurance
+1
Software Engineer 2, Ai Gateway
Software Engineer 2, Ai Gateway

Kong • Toscana

On-site
EUR 55,000 - 75,000
Equity
Bonus
Health, dental, and vision insurance
+1
AI Gateway Engineer: Multi-LLM Routing & Distributed
AI Gateway Engineer: Multi-LLM Routing & Distributed

Kong • Milano

Hybrid
EUR 45,000 - 65,000
Software Engineer 2, Ai Gateway
Software Engineer 2, Ai Gateway

Kong • Lecce

On-site
EUR 45,000 - 65,000
Equity
Bonus
Health insurance
+4
Software Engineer 2, AI Gateway
Software Engineer 2, AI Gateway

Kong • Milano

Remote
EUR 65,000 - 90,000
Software Engineer 2, Ai Gateway
Software Engineer 2, Ai Gateway

Kong • Perugia

On-site
EUR 60,000 - 90,000
Equity
Bonus
Health insurance
+4
Software Engineer 2, Ai Gateway
Software Engineer 2, Ai Gateway

Kong • Vicenza

On-site
EUR 55,000 - 85,000
Equity
Bonus
Health, dental, and vision insurance
+1
AI Gateway Software Engineer II — Scale LLM APIs
AI Gateway Software Engineer II — Scale LLM APIs

Kong • Perugia

On-site
EUR 60,000 - 90,000
Equity
Bonus
Health insurance
+4
Software Engineer 2, Ai Gateway
Software Engineer 2, Ai Gateway

Kong • Uri

Remote
EUR 60,000 - 90,000