VP, AI Infrastructure & Platform Operations

Archer; Florida; On-site; USD 170,000 - 260,000; Full time

Job summary

BNY seeks a Vice President, AI Infrastructure Support Engineer to join the AI Infrastructure Support team in Lake Mary, FL or New York, NY or Pittsburgh, PA. You will deliver operational support for AI infrastructure, GPUs, and distributed workloads, using Kubernetes, Docker, Ansible, Python, and Shell scripting.

You will collaborate across engineering and operations to implement DevOps, CI/CD with GitLab, and secure access management via Azure AD, while maintaining runbooks and documentation.

Qualifications

• Bachelor's degree or equivalent practical experience in CS/Engineering.
• Experience with AI infrastructure and GPU platforms in enterprise/production.
• Hands-on with NVIDIA A100/H100/B200 systems.
• Kubernetes and Docker familiarity for distributed workloads.
• Automation with Ansible, Python, and Shell scripting.
• DevOps practices with GitLab CI/CD and container deployments.
• Experience with JIRA and ServiceNow for incidents and changes.
• Strong networking, storage, Linux admin, and infra troubleshooting.
• IAM knowledge including Azure AD and secure access controls.
• Excellent communication and multitasking in fast-paced environments.

Responsibilities

• Provide operational support for AI infrastructure, GPU platforms, and production services.
• Deploy, orchestrate, and monitor AI/ML workloads across distributed environments with Kubernetes and Docker.
• Hands-on with NVIDIA GPU nodes (A100/H100/B200) for provisioning and tuning.
• Build and optimize automation scripts using Ansible, Python, and Shell.
• Manage incidents, service requests, and changes via Jira and ServiceNow.
• Collaborate with engineering, platform, and operations to implement DevOps practices including CI/CD with GitLab.
• Create runbooks, SOPs, and infrastructure documentation.
• Diagnose networking, storage, and Linux issues affecting HPC workloads.
• Participate in rotating on-call support, including occasional weekend coverage.

Skills

Kubernetes

Docker

Ansible

Python

Shell scripting

GitLab CI/CD

Azure AD

Linux

Networking

Troubleshooting

Education

Bachelor's degree in Computer Science or related field

Tools

JIRA

ServiceNow

GitLab

Job description

BNY seeks a Vice President, AI Infrastructure Support Engineer to join the AI Infrastructure Support team in Lake Mary, FL or New York, NY or Pittsburgh, PA. You will deliver operational support for AI infrastructure, GPUs, and distributed workloads, using Kubernetes, Docker, Ansible, Python, and Shell scripting.

You will collaborate across engineering and operations to implement DevOps, CI/CD with GitLab, and secure access management via Azure AD, while maintaining runbooks and documentation.