Software Engineer 2, Ai Gateway

Kong

Friuli-Venezia Giulia

On-site

EUR 65,000 - 100,000

Full time

12 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Equity
Bonus
Health, dental, and vision insurance
Paid holidays and PTO

Job summary

Kong in Italy is seeking an experienced systems-focused engineer to build and evolve the API management stack for AI/LLM workloads. You will work on proxying, load balancing, and platform integrations to deliver low-latency, reliable capabilities.

You should have hands-on skills with Golang or Rust, strong Linux troubleshooting, and experience with distributed systems. This role involves ownership, documentation, and collaboration in a globally distributed team.

Qualifications

  • 3+ years of server-side programming.
  • Hands-on experience with Golang or Rust.
  • Proven ability to build and debug highly scalable, distributed systems.
  • Strong Linux systems troubleshooting and profiling skills.
  • Experience with distributed systems and Linux networking on L7/L4.
  • Familiarity with AI/LLM concepts.

Responsibilities

  • Build and maintain API management software for AI/LLM stacks.
  • Develop features such as proxying, load balancing, and database support for Kong AI Gateway.
  • Troubleshoot bugs, tune performance, and perform low-level optimizations.
  • Bridge Kong with third-party deployment platforms and tooling.
  • Handle additional tasks as assigned by management.

Skills

Server-side
Golang
Rust
Distributed systems
Linux
Networking
Ownership
Communication
AI/LLM concepts
Team collaboration

Job description

Join the AI Gateway engineering team to help build and evolve Kong's API management stack for AI and LLM workloads. You will shape core features like multi-LLM routing, semantic caching, and high-scale components, partnering with a distributed team to deliver reliable, low-latency capabilities. You’ll work on proxying, load balancing, and platform integrations, driving performance and robustness. This role offers the chance to influence how enterprises govern AI-driven API traffic at scale. A strong candidate brings hands-on systems expertise and a proactive, ownership-driven approach.

  • Equity
  • Bonus
  • Health, dental, and vision insurance
  • Paid holidays and PTO
  • Build and maintain API management software for AI/LLM stacks
  • Develop features such as proxying, load balancing, and database support for Kong AI Gateway
  • Troubleshoot bugs, tune performance, and perform low-level optimizations
  • Bridge Kong with third-party deployment platforms and tooling
  • Handle additional tasks as assigned by management
  • 3+ years of server-side programming
  • Hands-on experience with Golang or Rust
  • Proven ability to build and debug highly scalable, distributed, reliable systems
  • Strong Linux systems troubleshooting and profiling skills
  • Experience with distributed systems and Linux networking on L7/L4
  • Comfortable working in a globally distributed team
  • Strong ownership and communication skills (documentation written by engineers)
  • Familiarity with AI/LLM concepts
  • ownership
  • clear written and verbal communication
  • collaboration in a distributed team
  • Golang
  • Rust
  • Linux systems programming and profiling
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Software Engineer 2, Ai Gateway
Software Engineer 2, Ai Gateway

Kong • Ancona

On-site
EUR 60,000 - 100,000
Equity
Bonus
Health insurance
+4
Software Engineer 2, Ai Gateway
Software Engineer 2, Ai Gateway

Kong • Toscana

On-site
EUR 55,000 - 75,000
Equity
Bonus
Health, dental, and vision insurance
+1
Software Engineer 2, Ai Gateway
Software Engineer 2, Ai Gateway

Kong • Lecce

On-site
EUR 45,000 - 65,000
Equity
Bonus
Health insurance
+4
Software Engineer 2, Ai Gateway
Software Engineer 2, Ai Gateway

Kong • Modena

On-site
EUR 55,000 - 80,000
Equity
Bonus
Health, dental, and vision insurance
+1
Software Engineer 2, Ai Gateway
Software Engineer 2, Ai Gateway

Kong • Vicenza

On-site
EUR 55,000 - 85,000
Equity
Bonus
Health, dental, and vision insurance
+1
Software Engineer 2, Ai Gateway
Software Engineer 2, Ai Gateway

Kong • Perugia

On-site
EUR 60,000 - 90,000
Equity
Bonus
Health insurance
+4
Software Engineer 2, Ai Gateway
Software Engineer 2, Ai Gateway

Kong • Piemonte

On-site
EUR 65,000 - 90,000
Equity
Bonus
Health insurance
+4
Software Engineer 2, Ai Gateway
Software Engineer 2, Ai Gateway

Kong • Trentino-Alto Adige

On-site
EUR 65,000 - 85,000
Equity
Bonus
Health, dental, and vision insurance
+1
Software Engineer 2, Ai Gateway
Software Engineer 2, Ai Gateway

Kong • Sardegna

On-site
EUR 60,000 - 90,000
Equity
Bonus
Health, dental, and vision insurance
+1
Software Engineer 2, Ai Gateway
Software Engineer 2, Ai Gateway

Kong • Napoli

On-site
EUR 45,000 - 75,000
Equity
Bonus
Health insurance
+4