VP, AI Infra & HPC Ops (GPU)

Apex Systems; New York (NY); On-site; USD 135,000 - 165,000; Full time

Benefits offered by this job

Medical benefits

401K with company match

ESPP

HSA program

Extensive training and certification

Job summary

Everforth Apex is seeking a Vice President, AI Infrastructure Support Engineer to lead operational support for AI infrastructure, GPU platforms, and production services. You will deploy and monitor AI/ML workloads using Kubernetes and Docker, manage NVIDIA GPU nodes, and drive automation with Ansible, Python, and Shell scripting, collaborating across teams to implement DevOps practices.

You will also handle incidents, change management with JIRA/ServiceNow, and contribute to runbooks, SOPs, and

Qualifications

• Bachelor's degree or equivalent experience in a related field.
• Extensive experience supporting AI infrastructure, GPU platforms, or HPC environments.
• Hands-on with NVIDIA GPU nodes (A100, H100, B200).
• Strong Kubernetes and Docker experience for distributed workloads.
• Proficient in Ansible, Python, and Shell scripting for automation and ops tasks.
• Experience with DevOps practices, GitLab CI/CD, and container-based delivery.
• Familiarity with JIRA and ServiceNow for ticketing and change management.
• Knowledge of networking, storage, Linux admin, and infra troubleshooting.
• Understanding of identity and access management, especially Azure AD.
• Strong communication and cross-functional collaboration, willingness to on-call.

Responsibilities

• Deliver operational support and drive issue resolution for AI infrastructure and GPU platforms.
• Deploy, orchestrate, and monitor AI/ML workloads across distributed environments using Kubernetes and Docker.
• Provision, tune, and operate NVIDIA GPU infrastructure (A100/H100/B200).
• Develop automation with Ansible, Python, and Shell scripting to improve reliability.
• Manage incidents, requests, and changes via JIRA and ServiceNow.
• Collaborate with engineering, platform, and operations teams to implement DevOps best practices (GitLab CI/CD).
• Create and maintain runbooks, SOPs, and architecture artifacts.
• Troubleshoot networking, storage, and Linux performance impacting HPC workloads.
• Participate in on-call rotations including occasional weekend coverage.

Skills

Leadership

On-call support

Cross-functional collaboration

Documentation

Problem solving

Education

Bachelor's degree or equivalent experience

Tools

Kubernetes

Docker

Ansible

Python

Shell scripting

GitLab CI/CD

Azure AD

JIRA

ServiceNow

Linux

NVIDIA A100/H100/B200

Job description

Everforth Apex is seeking a Vice President, AI Infrastructure Support Engineer to lead operational support for AI infrastructure, GPU platforms, and production services. You will deploy and monitor AI/ML workloads using Kubernetes and Docker, manage NVIDIA GPU nodes, and drive automation with Ansible, Python, and Shell scripting, collaborating across teams to implement DevOps practices.

You will also handle incidents, change management with JIRA/ServiceNow, and contribute to runbooks, SOPs, and