Senior Forward-Deployed AI Gateway Engineer (Customer)

Palo Alto Networks; New York (NY); On-site; USD 184,000 - 297,000; Full time

Job summary

Palo Alto Networks is seeking a Forward Deployed Engineer for AI Gateway who will embed with customer teams, write production code, and design low-latency topologies to bring enterprise AI workloads to production. You will bridge customer environments with core engine development, shipping secure, scalable solutions.

Responsibilities include building integration pipelines (Python/Go/TS), crafting middleware for security and routing, and collaborating with CISOs and engineers to enable zero-trust

Qualifications

• 7+ years writing production code (Python, Go, TypeScript/C++).
• Hands-on experience with LLM orchestration, prompt security, token optimization, model routing, and vector databases/RAG architectures.
• Proficiency in Kubernetes, Docker, Terraform, AWS/GCP/Azure, OIDC/OAuth2, and zero-trust networking.

Responsibilities

• Write production-grade code to integrate AI Gateway with microservices, API meshes, and multi-cloud architectures.
• Build custom middleware/plugins for identity-aware policies, prompt security, dynamic routing, and telemetry pipelines.
• Develop automated deployment modules (Terraform, Helm, Kubernetes) and SDK wrappers.
• Optimize high-throughput, low-latency traffic paths (streaming payloads, caching, load balancing).
• Lead Architecture Design Reviews with customer engineers and CISOs for zero-trust deployments.

Skills

Python

Go

TypeScript

C++

APIs (gRPC, REST, WebSockets)

Tools

Kubernetes

Docker

Terraform

Job description

Palo Alto Networks is seeking a Forward Deployed Engineer for AI Gateway who will embed with customer teams, write production code, and design low-latency topologies to bring enterprise AI workloads to production. You will bridge customer environments with core engine development, shipping secure, scalable solutions.

Responsibilities include building integration pipelines (Python/Go/TS), crafting middleware for security and routing, and collaborating with CISOs and engineers to enable zero-trust