VP, AI Infrastructure & GPU Ops Leader

TalentAlly; New York (NY); On-site; USD 180,000 - 260,000; Full time

Benefits offered by this job

Medical, dental, vision insurance

401k with company match

ESPP eligibility

Health Savings Account (HSA)

Job summary

Everforth Apex Systems seeks a Vice President, AI Infrastructure Support Engineer to lead hands-on operations for AI infrastructure, GPUs and production services. You will deploy and monitor AI/ML workloads using Kubernetes/Docker and optimize NVIDIA GPU nodes for performance and reliability.

You will automate with Ansible, Python, and shell scripts, manage incidents via JIRA/ServiceNow, and drive DevOps practices including CI/CD with GitLab.

Qualifications

• Bachelor's degree or equivalent practical experience.
• Strong experience supporting AI infrastructure, GPU platforms, or HPC environments.
• Hands-on experience with NVIDIA GPU nodes (A100, H100, B200).
• Solid understanding of Kubernetes and Docker for distributed workloads.
• Proficiency in Ansible, Python and shell scripting for automation and operations.
• Experience with DevOps practices and tools like GitLab CI/CD and container-based delivery.
• Familiarity with JIRA and ServiceNow for ticketing and ITSM.
• Knowledge of networking, Linux administration, and infrastructure troubleshooting.
• Understanding of identity and access management (Azure AD).
• Excellent written and verbal communication and ability to document processes.

Responsibilities

• Deliver operational support and drive issue resolution for AI infrastructure and GPU platforms.
• Support deployment, orchestration, and monitoring of AI/ML workloads with Kubernetes and Docker.
• Provide hands-on expertise with NVIDIA GPUs for provisioning, tuning, and ops.
• Build and maintain automation scripts using Ansible, Python, and shell scripting.
• Manage incidents, service requests, and changes via JIRA and ServiceNow.
• Collaborate with engineering, platform, and operations to implement DevOps best practices.
• Create runbooks, SOPs, and infrastructure architecture artifacts.
• Diagnose networking, storage, and system performance issues affecting AI workloads.
• Participate in rotating on-call coverage including occasional weekend shifts.

Skills

Leadership

Problem solving

Communication

Cross-functional collaboration

Documentation

Education

Bachelor's degree in Computer Science, Engineering, Information Technology, or related field

Tools

Kubernetes

Docker

Ansible

Python

Shell scripting

GitLab CI/CD

Azure AD

JIRA

ServiceNow

Job description

Everforth Apex Systems seeks a Vice President, AI Infrastructure Support Engineer to lead hands-on operations for AI infrastructure, GPUs and production services. You will deploy and monitor AI/ML workloads using Kubernetes/Docker and optimize NVIDIA GPU nodes for performance and reliability.

You will automate with Ansible, Python, and shell scripts, manage incidents via JIRA/ServiceNow, and drive DevOps practices including CI/CD with GitLab.