AI & HPC Infrastructure Director — Lead GPU AI Platforms

Socket.dev

New York (NY)

On-site

USD 250,000 - 380,000

Full time

13 days ago
Application generator

An application made for this job — a tailored resume and cover letter that speak straight to the posting.

Get past ATS filters

Job summary

BNY Mellon in New York seeks an AI & High Performance Computing Infrastructure Engineering Manager, Senior Director to lead the engineering and strategic evolution of its AI, ML, and HPC infrastructure platforms. You will manage a team of AI Infrastructure Engineers delivering GPU-based platforms across on‑prem, hybrid, and cloud environments.

The role defines the strategic roadmap, partners across Engineering, Architecture, Security, Risk, Compliance, and Production Services to ensure secure,

Qualifications

  • Leadership experience managing infrastructure/DevOps/SRE/production ops teams in large-scale environments.
  • Deep experience designing/operating AI, ML, GPU HPC platforms in production.
  • Strong Kubernetes, container platforms, GPU orchestration, automation practices.

Responsibilities

  • Lead and develop a team of AI Infrastructure Engineers responsible for building, operating, and scaling AI/HPC platforms.
  • Define and execute the strategic roadmap for AI infrastructure across on‑prem, hybrid, and cloud environments.
  • Drive GPU-based infrastructure design, deployment, and optimization for model training, inference, and AI workloads.

Skills

Leadership
Kubernetes
GPU HPC
AI Infrastructure
CI/CD

Education

Bachelor's degree in CS/Engineering/IT

Tools

Terraform
Ansible
Helm
ArgoCD
GitLab
Jenkins

Job description

BNY Mellon in New York seeks an AI & High Performance Computing Infrastructure Engineering Manager, Senior Director to lead the engineering and strategic evolution of its AI, ML, and HPC infrastructure platforms. You will manage a team of AI Infrastructure Engineers delivering GPU-based platforms across on‑prem, hybrid, and cloud environments.

The role defines the strategic roadmap, partners across Engineering, Architecture, Security, Risk, Compliance, and Production Services to ensure secure,

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior Director, AI & GPU Infrastructure Engineering
Senior Director, AI & GPU Infrastructure Engineering

BNY • New York (NY)

On-site
USD 200,000 - 320,000
Senior Director, Data & AI Platform Engineering
Senior Director, Data & AI Platform Engineering

Socket.dev • New York (NY)

On-site
USD 260,000 - 350,000
Paid time off
Volunteer time off
401(k) plan
Senior Director, AI-Driven Data Platform Leadership
Senior Director, AI-Driven Data Platform Leadership

BNY Mellon • New York (NY)

On-site
USD 210,000 - 300,000
Director, AI Delivery & Portfolio Lead
Director, AI Delivery & Portfolio Lead

BNY Mellon • New York (NY)

On-site
USD 180,000 - 250,000
Chief AI/ML Systems Architect & VP Engineering
Chief AI/ML Systems Architect & VP Engineering

BNY Mellon • New York (NY)

On-site
USD 150,000 - 200,000
Highly competitive compensation
Generous paid leaves including volunteer time
Wellbeing programs and resources
Director, Technical AI Product Management
Director, Technical AI Product Management

BNY Mellon • New York (NY)

On-site
USD 150,000 - 200,000
Director, AI Platform Product Management
Director, AI Platform Product Management

BNY • New York (NY)

On-site
USD 180,000 - 240,000
Paid time off
Volunteer time off
401(k) plan
+1
Enterprise AI Delivery Leader
Enterprise AI Delivery Leader

BNY Mellon • New York (NY)

On-site
USD 200,000 - 260,000
VP, AI Data Transfer, Integration & Quality
VP, AI Data Transfer, Integration & Quality

BNY Mellon • New York (NY)

On-site
USD 190,000 - 260,000
Head of Frontier AI Solutions & Architecture
Head of Frontier AI Solutions & Architecture

BNY • New York (NY)

On-site
USD 180,000 - 260,000