Lead Kong AI Gateway Architect (Remote)

Allstate; United States; Remote; USD 100,000 - 171,000; Full time

Job summary

Allstate is seeking a Software Engineer Lead Consultant to architect and deliver enterprise-grade AI Gateway solutions with Kong AI Gateway. You will configure policies for prompts, token controls, and guardrails while enabling access to multiple LLM providers via a unified gateway.

The role emphasizes AI observability, cost governance, secure API management, and scalable routing across models, in a modern Kubernetes/AWS/Azure/GCP environment. Central/Eastern time hours apply.

Qualifications

• 8+ years of API Management, Middleware, or Platform Engineering.
• 3–5 years hands-on Kong Gateway Administration.
• Experience with cloud-native microservices architectures.
• Experience with AI Architecture, LLM evaluation, and guardrails.

Responsibilities

• Design and implement enterprise AI Gateway solutions using Kong AI Gateway.
• Enable secure access to multiple LLM providers via a unified gateway.
• Implement AI observability, token analytics and cost governance.
• Develop routing across AI models based on latency and cost.
• Integrate RAG-based AI services through secure API management.

Skills

APIs & API Management

Kong AI Gateway

AI Proxy Development

OpenAI Integration

REST & GraphQL

OAuth2 / JWT / OIDC

Kubernetes / Docker

CI/CD Automation

Monitoring & Observability

Cloud Platforms (Azure/AWS/GCP)

AI Governance & Security

LLMOps & AI Platform

Tools

Kong Gateway

Kubernetes

Docker

Helm

CI/CD tools

Jenkins

GitHub Actions

Azure DevOps

Prometheus

Grafana

ELK/Splunk

Azure

AWS

GCP

OpenAI

Job description

Allstate is seeking a Software Engineer Lead Consultant to architect and deliver enterprise-grade AI Gateway solutions with Kong AI Gateway. You will configure policies for prompts, token controls, and guardrails while enabling access to multiple LLM providers via a unified gateway.

The role emphasizes AI observability, cost governance, secure API management, and scalable routing across models, in a modern Kubernetes/AWS/Azure/GCP environment. Central/Eastern time hours apply.