Senior AI Gateway Architect — Secure, Multi-Cloud

Jobtailor; Town of Florida (NY); On-site; USD 180,000 - 240,000; Full time

Job summary

Jobtailor in New York seeks a senior Enterprise AI Gateway Architect to lead the architecture, engineering, security, and operations of the enterprise AI Gateway platform, primarily using Kong AI Gateway. You will enable secure, scalable consumption of LLMs and AI services across multi-cloud environments.

The role requires 8–12 years of experience in enterprise API platforms and cloud security, with hands-on Kong expertise and preferred certifications.

Qualifications

• 8 to 12 years of experience
• Bachelor's degree in Computer Science, Cyber Security, Information Technology, Engineering, or related discipline
• 8+ years of experience designing and operating enterprise API, application, or cloud platforms
• 5+ years of experience in cloud architecture and security
• 3+ years working with AI/ML platform technologies or enterprise AI deployments
• Hands-on experience implementing and managing Kong Gateway and Kong Enterprise solutions
• Experience within regulated industries such as financial services, banking, insurance, or capital markets strongly preferred
• Kong Certified Professional certification preferred
• AWS Solutions Architect certification preferred
• Microsoft Azure Solutions Architect certification preferred
• CISSP, CCSP, or equivalent security certification preferred
• Experience implementing AI security controls and governance frameworks preferred
• Familiarity with NIST AI RMF, NIST 800-53, NYDFS 500, PCI DSS, SOC 2, and other financial services regulatory requirements preferred
• Experience with DSPM, DLP, and enterprise data protection controls preferred

Responsibilities

• Lead architecture and operations of the enterprise AI Gateway platform using Kong
• Enable secure, scalable consumption of LLMs, AI Agents, and related services
• Design and evolve gateway solutions with Kong Enterprise
• Develop onboarding patterns for apps, AI agents, and business services
• Engineer integrations for OpenAI, Azure OpenAI, AWS Bedrock, Anthropic, and more
• Implement governance, policy enforcement, and AI security measures
• Define scalable control and data plane architectures across multi-cloud environments
• Architect identity controls and IAM integrations
• Implement OAuth 2.0, OIDC, JWT, mTLS, RBAC, ABAC and workload identities
• Establish policy-as-code, logging, monitoring, and audit controls
• Collaborate with Risk, Compliance, Legal, and AI Governance teams
• Design highly available, multi-region deployments with DR/BC controls
• Implement rate limiting, load balancing, and traffic shaping
• Define and manage SLOs, SLIs, and error budgets
• Conduct architecture reviews, resilience testing, and failure-scenario exercises
• Design AI access patterns across Azure, AWS, and Snowflake
• Integrate gateway with cloud AI services and observability tooling
• Build observability for AI workloads: metrics, tracing, audit logs
• Analyze token consumption, latency, cost, and security events
• Create dashboards for engineering, security, risk, and executives
• Support incident response and platform troubleshooting

Skills

Kong AI Gateway Implementation

Cloud Architecture and Security

AI Security Controls and Governance

Enterprise API Management

Regulatory Compliance Experience

Education

Bachelor's degree in Computer Science or related discipline

Tools

Kong Enterprise Solutions

OpenAI

Azure OpenAI

AWS Bedrock

Snowflake Cortex

Observability Tooling

Identity & Access Management Platforms

Job description

Jobtailor in New York seeks a senior Enterprise AI Gateway Architect to lead the architecture, engineering, security, and operations of the enterprise AI Gateway platform, primarily using Kong AI Gateway. You will enable secure, scalable consumption of LLMs and AI services across multi-cloud environments.

The role requires 8–12 years of experience in enterprise API platforms and cloud security, with hands-on Kong expertise and preferred certifications.