Senior GenAI Gateway Engineer

Allstate; Springfield (IL); A distancia; USD 140.000 - 190.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Connectivity reimbursement

Descripción de la vacante

Allstate is seeking a Software Engineer Lead Consultant to serve as a technical leader for Kong AI Gateway, architecting, designing, building, testing, and supporting modern digital AI-driven products. You will own applications through production and drive their success against KPIs.

The role emphasizes AI gateway configuration, multi-LLM integration, AI observability, and governance across enterprise ecosystems, with a focus on reliability, security, and cost governance.

Formación

• 8+ years of experience in API Management, Middleware, or Platform Engineering.
• Experience with cloud-native and microservices architectures.
• Experience with Kong AI Gateway and AI/LLM platforms is preferred.

Responsabilidades

• Lead design and implementation of enterprise-grade AI Gateway solutions using Kong AI Gateway.
• Configure AI-specific policies including prompt logging, content filtering, token controls, and guardrails.
• Develop routing strategies across multiple AI models based on latency, cost, and availability.
• Integrate RAG-based AI services through secure API management frameworks.
• Ensure compliance with enterprise AI governance, security, and regulatory requirements.

Conocimientos

API gateway mgmt

Kong admin

AI/LLM proxy

CI/CD pipelines

Cloud platforms

Monitoring tools

Vector databases

LLMOps

AI governance

Multi-LLM

Security

Performance monitoring

Herramientas

Kong AI Gateway

Prometheus

Grafana

ELK

Splunk

Jenkins

GitHub Actions

Azure DevOps

Azure

AWS

GCP

Descripción del empleo

Allstate is seeking a Software Engineer Lead Consultant to serve as a technical leader for Kong AI Gateway, architecting, designing, building, testing, and supporting modern digital AI-driven products. You will own applications through production and drive their success against KPIs.

The role emphasizes AI gateway configuration, multi-LLM integration, AI observability, and governance across enterprise ecosystems, with a focus on reliability, security, and cost governance.