AI Gateway Backend Engineer: Real-Time, Secure Routing

P4N Solutions; Town of Texas (WI); On-site; USD 150,000 - 210,000; Full time

Job summary

P4N Solutions is recruiting an AI Gateway Backend Engineer to build a high‑performance, secure intermediary layer that routes, inspects, and governs traffic between enterprise apps and LLM/AI providers.

The role emphasizes async Python, FastAPI, containerization, and cloud infra, with experience in streaming data, security, and scalable architectures. On-site opportunity with enterprise-scale challenges.

Qualifications

• Experience building high-performance gateway services with low-latency networking.
• Proficient in async Python and modern API frameworks.
• Hands-on with cloud infrastructure, containers, and Kubernetes.

Responsibilities

• Design and operate a scalable AI gateway handling real-time streaming traffic.
• Implement secure, policy-driven routing and inspection between apps and AI providers.
• Develop REST/Streaming APIs with FastAPI and maintain CI/CD pipelines.

Skills

Async Python

Network Programming

HTTP/2 & HTTP/3

gRPC

FastAPI

Kubernetes

Redis Streams

Kafka /RabbitMQ

PostgreSQL

Vault

Terraform

Envoy / Istio

Tools

Docker

AKS/EKS/GKE

Pydantic

TLS / mTLS

PgBouncer

Canary / Blue-Green Deployments

Envoy

Job description

P4N Solutions is recruiting an AI Gateway Backend Engineer to build a high‑performance, secure intermediary layer that routes, inspects, and governs traffic between enterprise apps and LLM/AI providers.

The role emphasizes async Python, FastAPI, containerization, and cloud infra, with experience in streaming data, security, and scalable architectures. On-site opportunity with enterprise-scale challenges.