Lead Kong AI Gateway Engineer (Remote)

Allstate; Alton (IL); A distancia; USD 140.000 - 200.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Connectivity reimbursement

Descripción de la vacante

Allstate seeks a Software Engineer Lead Consultant focused on Kong AI Gateway, with API gateway management, Kong administration, and AI/LLM proxy development. Architect, design, build and support modern digital products, owning apps in production and driving success against KPIs.

Responsibilities include designing enterprise-grade AI gateway solutions, configuring AI policies, observability, cost governance, multi-LLM routing, secure APIs, and governance across the enterprise.

Formación

• 8 Plus years of experience in API Management, Middleware, or Platform Engineering.
• Experience with cloud-native and microservices architectures preferred.
• AI Architecture, AI Systems, LLM Evaluation, LLM Guardrails, Product Ownership, Software Architectures, Software Development.

Responsabilidades

• Design and implement enterprise-grade AI Gateway solutions using Kong AI Gateway.
• Configure AI-specific policies including prompt logging, content filtering, token controls, and guardrails.
• Implement AI observability, token analytics, usage tracking, and cost governance.
• Develop routing strategies across multiple AI models based on latency, cost, and availability.
• Integrate RAG-based AI services through secure API management frameworks.
• Ensure compliance with enterprise AI governance, security, and regulatory requirements.
• Establish AI platform standards, reusable AI APIs, and best practices for GenAI adoption.
• Support AI agent and MCP-based integrations within enterprise ecosystems.
• Drive AI platform reliability, scalability, and operational excellence.
• Develop and manage AI Gateway proxies for GenAI/LLM services.
• Implement API security, authentication, throttling, and governance policies.
• Integrate AI platforms such as Azure OpenAI and OpenAI through secure API gateways.
• Monitor, troubleshoot, and optimize gateway performance and availability.
• Automate deployments and operational processes using DevOps tools.

Conocimientos

API Management

Middleware

Platform Engineering

Cloud-native

Microservices

Herramientas

Kong AI Gateway

OpenAI integration

Azure

AWS

GCP

Prometheus

Grafana

ELK/Splunk

Descripción del empleo

Allstate seeks a Software Engineer Lead Consultant focused on Kong AI Gateway, with API gateway management, Kong administration, and AI/LLM proxy development. Architect, design, build and support modern digital products, owning apps in production and driving success against KPIs.

Responsibilities include designing enterprise-grade AI gateway solutions, configuring AI policies, observability, cost governance, multi-LLM routing, secure APIs, and governance across the enterprise.