Lead Kong AI Gateway Engineer

Allstate Insurance; United States; Remote; USD 100,000 - 171,000; Full time

Job summary

Allstate is seeking a Software Engineer Lead Consultant to architect and deliver enterprise AI gateway solutions, focusing on Kong AI Gateway, API management, and secure multi-LLM integration. You will lead design, testing, and production support while driving performance goals.

You will work with OpenAI/Azure OpenAI integrations, Kubernetes, and DevOps practices to ensure scalable, observable, and secure gateway platforms across the enterprise.

Qualifications

• 8+ years in API Management, Middleware, or Platform Engineering.
• Minimum 3–5 years hands‑on Kong Gateway Administration.
• Experience with cloud-native/microservices architectures preferred.

Responsibilities

• Design and implement enterprise AI Gateway solutions using Kong AI Gateway.
• Configure AI‑specific policies including guardrails and token controls.
• Enable secure access to multiple LLM providers through a unified gateway.
• Implement AI observability, token analytics, and cost governance.
• Develop routing strategies across multiple AI models based on latency, cost, and availability.
• Integrate RAG-based AI services through secure API management frameworks.
• Ensure compliance with enterprise AI governance and security.

Skills

API Management

Kong Gateway

AI Gateway

REST APIs

GraphQL

OAuth 2.0

Kubernetes

CI/CD

Cloud Platforms

Observability

RAG Architecture

LLMOps

GenAI Platform Engineering

Tools

Kong Gateway Administration

Docker

Helm

Grafana

Prometheus

ELK/Splunk

CI/CD Tools

Azure/AWS/GCP

Kong Konnect

Job description

Allstate is seeking a Software Engineer Lead Consultant to architect and deliver enterprise AI gateway solutions, focusing on Kong AI Gateway, API management, and secure multi-LLM integration. You will lead design, testing, and production support while driving performance goals.

You will work with OpenAI/Azure OpenAI integrations, Kubernetes, and DevOps practices to ensure scalable, observable, and secure gateway platforms across the enterprise.