VP, AI Infrastructure & GPU Platform Operations

BNY; Florida; Hybrid; USD 180,000 - 240,000; Full time

Job summary

BNY seeks a Vice President, AI Infrastructure Support Engineer to join the AI Infrastructure Support team in Lake Mary, FL or New York, NY or Pittsburgh, PA. You will deliver operational support for AI infrastructure, deploy AI/ML workloads, and drive efficiency through automation.

You will work with Kubernetes, Docker, NVIDIA GPUs (A100/H100/B200), and DevOps tooling to ensure high availability and scalable platform operations. Occasional on-call weekend coverage is required.

Qualifications

• Bachelor's degree in Computer Science, Engineering, IT or related field, or equivalent practical experience.
• Strong experience supporting AI infrastructure, GPU platforms, or HPC environments in enterprise or production settings.
• Hands-on experience with NVIDIA GPU nodes (A100, H100, B200).
• Solid understanding of Kubernetes and Docker for distributed workloads.

Responsibilities

• Deliver operational support and drive issue resolution for AI infrastructure, GPU platforms, and production services.
• Deploy, orchestrate, and monitor AI/ML workloads across distributed environments using Kubernetes and Docker.
• Manage incidents, service requests, and change activity through enterprise ticketing platforms such as JIRA and ServiceNow.
• Develop automation scripts using Ansible, Python and Shell scripting to improve efficiency and reliability.
• Collaborate across teams to implement DevOps best practices, including CI/CD with GitLab and secure access management via Azure AD.

Skills

Kubernetes (K8s)

Docker

NVIDIA GPU infrastructure

Ansible

Python

Shell scripting

GitLab CI/CD

JIRA

ServiceNow

Azure AD

DevOps practices

Education

Bachelor's degree in Computer Science or related field

Tools

NVIDIA GPU nodes

A100

H100

Job description

BNY seeks a Vice President, AI Infrastructure Support Engineer to join the AI Infrastructure Support team in Lake Mary, FL or New York, NY or Pittsburgh, PA. You will deliver operational support for AI infrastructure, deploy AI/ML workloads, and drive efficiency through automation.

You will work with Kubernetes, Docker, NVIDIA GPUs (A100/H100/B200), and DevOps tooling to ensure high availability and scalable platform operations. Occasional on-call weekend coverage is required.