AI Gateway Engineering Associate Director

The Depository Trust & Clearing Corporation (DTCC); Jersey City (NJ); Hybrid; USD 140,000 - 210,000; Full time

Benefits offered by this job

Health insurance

Pension/Retirement

Paid time off

Job summary

DTCC is seeking a Senior AI Gateway Engineer to lead the architecture, engineering, security, and operations of its enterprise AI Gateway platform, focusing on Kong AI Gateway. You will shape governance, IAM integration, and resilience for a regulated financial services environment.

Ideal candidates have 8+ years in enterprise API/cloud platforms, strong Kong experience, and a track record in security and governance. This role supports a hybrid work model and nationwide multi-region operations.

Qualifications

• Bachelor's degree in Computer Science, Cyber Security, Information Technology, Engineering, or related field.
• Master's degree preferred.
• Min 8 years of relevant experience.

Responsibilities

• Design, implement, and evolve enterprise AI Gateway solutions using Kong AI Gateway and Kong Enterprise.
• Develop onboarding patterns for applications, AI agents, and business services consuming AI.
• Engineer reusable integration patterns for OpenAI, Azure OpenAI, AWS Bedrock, Anthropic, Snowflake Cortex, and internal/external AI services.
• Implement intelligent model routing, failover, traffic shaping, and provider abstraction.
• Develop custom Kong plugins and integrations supporting AI-specific governance and security requirements.
• Define scalable control plane and data plane deployment architectures across hybrid and multi-cloud environments.

Skills

AI Gateway

Kong Gateway

Cloud architecture

IAM

Security governance

Education

Bachelor's degree

Master's degree preferred

Tools

Kong Enterprise

Azure OpenAI

AWS Bedrock

Snowflake Cortex

Job description

Are you ready to make an impact at DTCC?

Do you want to work on innovative projects, collaborate with a dynamic and supportive team, and receive investment in your professional development? At DTCC, we are at the forefront of innovation in the financial markets. We are committed to helping our employees grow and succeed. We believe that you have the skills and drive to make a real impact. We foster a thriving internal community and are committed to creating a workplace that looks like the world that we serve.

The Information Technology group delivers secure, reliable technology solutions that enable DTCC to be the trusted infrastructure of the global capital markets. The team delivers high-quality information through activities that include development of essential, building infrastructure capabilities to meet client needs and implementing data standards and governance.

Pay And Benefits

• Competitive compensation, including base pay and annual incentive
• Comprehensive health and life insurance and well-being benefits, based on location
• Pension / Retirement benefits
• Paid Time Off and Personal/Family Care, and other leaves of absence when needed to support your physical, financial, and emotional well-being.
• DTCC offers a flexible/hybrid model of 3 days onsite and 2 days remote (onsite Tuesdays, Wednesdays and a third day unique to each team or employee).

The Impact You Will Have In This Role

Being a member of CISO Team, this role is critical to enabling the organization’s AI strategy by providing a secure, resilient, and governed platform for AI innovation. The Senior AI Gateway Engineer will play a foundational role in establishing the control plane through which enterprise AI interactions are managed, secured, monitored, and governed, while ensuring the resilience expected of a systemically important financial services organization. The Senior AI Gateway Engineer will lead the architecture, engineering, security, and operational management of our enterprise AI Gateway platform with a primary focus on Kong AI Gateway.

This role will serve as the technical authority responsible for enabling secure, resilient, compliant, and scalable consumption of Large Language Models (LLMs), AI Agents, Retrieval Augmented Generation (RAG) services, Model Context Protocol (MCP) services, and Agent-to-Agent (A2A) communications across the enterprise.

The successful candidate will combine expertise in Kong AI Gateway, cloud architecture, AI security, identity and access management (IAM), resiliency engineering, and enterprise governance to deliver a highly available AI platform that meets the demands of a regulated financial services environment.

Your Primary Responsibilities

AI Gateway Architecture & Engineering

• Design, implement, and evolve enterprise AI Gateway solutions using Kong AI Gateway and Kong Enterprise.
• Develop standardized onboarding patterns for applications, AI agents, and business services consuming AI.
• Engineer reusable integration patterns for OpenAI, Azure OpenAI, AWS Bedrock, Anthropic, Snowflake Cortex, and internal and external AI services.
• Implement intelligent model routing, failover, traffic shaping, and provider abstraction.
• Develop custom Kong plugins and integrations supporting AI-specific governance and security requirements.
• Define scalable control plane and data plane deployment architectures across hybrid and multi-cloud environments.

Identity & Access Management for AI

• Architect and implement enterprise-grade identity controls for AI platforms.
• Integrate Kong AI Gateway with enterprise identity providers and IAM platforms.
• Implement OAuth 2.0, OpenID Connect (OIDC), JWT, mutual TLS (mTLS), RBAC, ABAC, non-human identities, workload identities, and agent identities.
• Establish fine-grained authorization controls at the model, agent, tool, prompt, and data source levels.
• Design identity propagation patterns across AI workflows and MCP services.
• Partner with security and compliance teams to establish AI governance and Zero Trust controls.

AI Security, Governance & Risk Management

• Implement AI security guardrails and policy enforcement mechanisms.
• Design controls for prompt injection protection, data loss prevention (DLP), PII detection and redaction, content safety enforcement, prompt and response filtering, and model access governance.
• Establish policy-as-code practices to manage AI controls at scale.
• Define logging, monitoring, and audit controls supporting regulatory and compliance requirements.
• Collaborate with Risk, Compliance, Legal, Data Protection, and AI Governance teams.

Resiliency, Reliability & Operational Excellence

• Design highly available and resilient AI platform architectures.
• Establish enterprise resiliency requirements including multi-region deployment strategies, provider failover, cross-cloud recovery patterns, active-active architectures, disaster recovery, and business continuity controls.
• Implement rate limiting, circuit breakers, load balancing, traffic throttling, semantic caching, and capacity management.
• Define and manage Service Level Objectives (SLOs), Service Level Indicators (SLIs), error budgets, Recovery Time Objectives (RTOs), and Recovery Point Objectives (RPOs).
• Conduct architecture reviews, resilience testing, and failure scenario exercises.

Cloud & Data Platform Integration

• Design AI access patterns across Microsoft Azure, Amazon Web Services (AWS), and Snowflake.
• Integrate AI Gateway services with Azure OpenAI, AWS Bedrock, Snowflake Cortex, vector databases, data protection platforms, and enterprise observability tooling.
• Ensure secure connectivity and standardized governance across multi-cloud environments.

Observability & Platform Operations

• Build enterprise observability capabilities for AI workloads.
• Implement monitoring, metrics, tracing, and audit logging.
• Analyze token consumption, latency, model utilization, cost optimization opportunities, and security events.
• Create operational dashboards for engineering, security, risk, and executive stakeholders.
• Support incident response and platform troubleshooting efforts.

NOTE: The Primary Responsibilities of this role are not limited to the details above.

Qualifications

• Bachelor's degree in Computer Science, Cyber Security, Information Technology, Engineering, and/or related discipline.
• Master's degree preferred.
• Min 8 years of relevant experience

Talents Needed For Success

• 8+ years of experience designing and operating enterprise API, application, or cloud platforms.
• 5+ years of experience in cloud architecture and security.
• 3+ years working with AI/ML platform technologies or enterprise AI deployments.
• Hands-on experience implementing and managing Kong Gateway and Kong Enterprise solutions.
• Experience within regulated industries such as financial services, banking, insurance, or capital markets strongly preferred.

Technical Skills

AI Gateway & Platform Technologies

Kong AI Gateway; Kong Enterprise; API gateway technologies; service mesh concepts; MCP and Agent-to-Agent architectures; LLM platforms and AI orchestration frameworks.

Cloud Platforms

Microsoft Azure; Azure OpenAI; AWS; AWS Bedrock; hybrid and multi-cloud architectures.

Data & Analytics Platforms

Snowflake; Snowflake Cortex; vector databases; RAG architectures; data governance platforms.

IAM & Security

OAuth 2.0; OIDC; JWT; SAML; mTLS; privileged access management; secrets management; Zero Trust architecture; identity federation; machine and agent identity.

Programming & Automation

Python; Terraform; Kubernetes; GitHub Actions; CI/CD; Infrastructure as Code; Policy as Code.

Preferred Qualifications

• Kong Certified Professional certification.
• AWS Solutions Architect certification.
• Microsoft Azure Solutions Architect certification.
• CISSP, CCSP, or equivalent security certification.
• Experience implementing AI security controls and governance frameworks.
• Familiarity with NIST AI RMF, NIST 800-53, NYDFS 500, PCI DSS, SOC 2, and other financial services regulatory requirements.
• Experience with DSPM, DLP, and enterprise data protection controls.

Key Success Metrics

• Successful deployment and adoption of enterprise AI Gateway services.
• Reduction of direct AI provider integrations through centralized governance.
• Achievement of enterprise resiliency and availability targets.
• Compliance with security, privacy, and regulatory requirements.
• Improved AI observability, auditability, and cost management.
• Successful implementation of AI identity and authorization controls.
• Reduction in AI-related security risks and policy violations.

The salary range is indicative for roles at the same level within DTCC across all US locations. Actual salary is determined based on the role, location, individual experience, skills, and other considerations. We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.