Senior Director, AI & GPU Infrastructure Engineering

BNY; New York (NY); On-site; USD 200,000 - 320,000; Full time

Job summary

BNY seeks an AI Infrastructure Engineering Manager, Senior Director in New York to lead the engineering and strategic evolution of the firm’s AI, machine learning, and high‑performance computing infrastructure platforms.

You will build and scale GPU‑based infrastructure, guide Kubernetes and automation, and partner with Security, Risk, and AI/ML teams to deliver secure, resilient platforms.

Qualifications

• Proven leadership experience managing infrastructure engineering, platform engineering, DevOps, or production operations teams.
• Deep expertise designing and operating AI, machine learning, GPU, HPC, or distributed computing platforms in production.

Responsibilities

• Lead a team of AI Infrastructure Engineers to build, operate, and scale AI/ML/HPC platforms.
• Define and execute the strategic roadmap for AI infrastructure across on‑prem, hybrid, and cloud environments.
• Drive GPU orchestration, Kubernetes, infrastructure automation, and performance engineering.
• Establish operating models, service standards, and production readiness requirements.
• Manage technology vendors, conducting technical evaluations and proof-of-concepts.

Skills

AI Infrastructure Leadership

Kubernetes & GPU Orchestration

Hybrid Cloud Architecture

Terraform/Automation

Observability & Performance

Stakeholder Communication

Education

Bachelor's degree in Computer Science or Engineering

Tools

Kubernetes

Terraform

Ansible

Helm

ArgoCD

GitLab/Jenkins

Job description

BNY seeks an AI Infrastructure Engineering Manager, Senior Director in New York to lead the engineering and strategic evolution of the firm’s AI, machine learning, and high‑performance computing infrastructure platforms.

You will build and scale GPU‑based infrastructure, guide Kubernetes and automation, and partner with Security, Risk, and AI/ML teams to deliver secure, resilient platforms.