Vice President, AI Infrastructure Support Engineer

BNY; Florida; On-site; USD 180,000 - 240,000; Full time

Job summary

BNY seeks a Vice President, AI Infrastructure Support Engineer to join the AI Infrastructure Support team in Lake Mary, FL or New York, NY or Pittsburgh, PA. You will deliver operational support for AI infrastructure, deploy AI/ML workloads, and drive efficiency through automation.

You will work with Kubernetes, Docker, NVIDIA GPUs (A100/H100/B200), and DevOps tooling to ensure high availability and scalable platform operations. Occasional on-call weekend coverage is required.

Qualifications

• Bachelor's degree in Computer Science, Engineering, IT or related field, or equivalent practical experience.
• Strong experience supporting AI infrastructure, GPU platforms, or HPC environments in enterprise or production settings.
• Hands-on experience with NVIDIA GPU nodes (A100, H100, B200).
• Solid understanding of Kubernetes and Docker for distributed workloads.

Responsibilities

• Deliver operational support and drive issue resolution for AI infrastructure, GPU platforms, and production services.
• Deploy, orchestrate, and monitor AI/ML workloads across distributed environments using Kubernetes and Docker.
• Manage incidents, service requests, and change activity through enterprise ticketing platforms such as JIRA and ServiceNow.
• Develop automation scripts using Ansible, Python and Shell scripting to improve efficiency and reliability.
• Collaborate across teams to implement DevOps best practices, including CI/CD with GitLab and secure access management via Azure AD.

Skills

Kubernetes (K8s)

Docker

NVIDIA GPU infrastructure

Ansible

Python

Shell scripting

GitLab CI/CD

JIRA

ServiceNow

Azure AD

DevOps practices

Education

Bachelor's degree in Computer Science or related field

Tools

NVIDIA GPU nodes

A100

H100

Job description

At BNY, our culture allows us to run our company better and enables employees’ growth and success. As a leading global financial services company at the heart of the global financial system, we influence nearly 20% of the world’s investible assets. Every day, our teams harness cutting-edge AI and breakthrough technologies to collaborate with clients, driving transformative solutions that redefine industries and uplift communities worldwide.

Recognized as a top destination for innovators, BNY is where bold ideas meet advanced technology and exceptional talent. Together, we power the future of finance – and this is what #LifeAtBNY is all about. Join us and be part of something extraordinary.

We’re seekinga future team member for the role ofVice President, AI Infrastructure Support Engineer to join ourAI Infrastructure Supportteam inLake Mary, FL or New York, NY or Pittsburgh, PALocation.

In this role, you'll make an impact in the following ways:

• Deliver operational support and drive issue resolution for AI infrastructure, GPU platforms, and associated production services.
• Support the deployment, orchestration, and monitoring of AI/ML workloads across distributed environments using Kubernetes and Docker.
• Apply hands-on expertise with NVIDIA GPU infrastructure, including A100, H100, and B200 nodes, to support provisioning, utilization, performance tuning, and ongoing platform operations.
• Build, maintain, and optimize automation scripts and tooling using Ansible, Python and Shell scripting to improve efficiency and reliability.
• Manage incidents, service requests, and change activity through enterprise workflow and ticketing platforms such as JIRA and ServiceNow.
• Partner with cross-functional teams across engineering, platform, and operations to implement DevOps best practices, including CI/CD using GitLab, containerized deployment models, and secure access management through Azure AD.
• Create and maintain clear technical documentation, including runbooks, standard operating procedures, support guides, and infrastructure architecture artifacts.
• Diagnose and resolve networking, storage, and system performance issues affecting AI infrastructure and high-performance compute workloads.
• Participate in a rotating on-call support model, including occasional weekend coverage, to help maintain high availability and operational excellence.

To be successful in this role, we’re seeking the following:

• Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related field, or equivalent practical experience.
• Strong experience supporting AI infrastructure, GPU platforms, or high-performance compute environments in enterprise or production settings.
• Hands-on experience working with NVIDIA GPU nodes, including A100, H100, and B200 systems.
• Solid understanding of Kubernetes and Docker for deploying, managing, and troubleshooting distributed workloads.
• Proficiency in Ansible, Python and Shell scripting for automation, tooling, and operational support tasks.
• Experience with DevOps practices and tools, including GitLab CI/CD, infrastructure automation, and container-based delivery models.
• Familiarity with enterprise ticketing and service management platforms such as JIRA and ServiceNow.
• Good knowledge of networking, storage, Linux systems administration, and infrastructure troubleshooting in complex technical environments.
• Understanding of identity and access management, including secure access controls such as Azure AD.
• Strong problem-solving skills, attention to detail, and the ability to manage multiple priorities in a fast-paced environment.
• Effective written and verbal communication skills, with the ability to document processes and collaborate across technical and non-technical teams.
• Willingness to participate in on-call rotations and provide occasional weekend support as needed.

At BNY, our culture speaks for itself, checkout the latest BNY news at:

BNY Newsroom

BNY LinkedIn

Here’s a few of our recent awards:

• America’s Most Innovative Companies, Fortune, 2025
• World’s Most Admired Companies, Fortune 2025
• "Most Just Companies", Just Capital and CNBC, 2025

Our Benefits and Rewards:

BNY offers highly competitive compensation, benefits, and wellbeing programs rooted in a strong culture of excellence and our pay-for-performance philosophy. We provide access to flexible global resources and tools for your life’s journey. Focus on your health, foster your personal resilience, and reach your financial goals as a valued member of our team, along with generous paid leaves, including paid volunteer time, that can support you and your family through moments that matter.

BNY is an Equal Employment Opportunity/Affirmative Action Employer - Underrepresented racial and ethnic groups/Females/Individuals with Disabilities/Protected Veterans.