Vice President - AI Infrastructure Support Engineer

TalentAlly; New York (NY); On-site; USD 180,000 - 260,000; Full time

Benefits offered by this job

Medical, dental, vision insurance

401k with company match

ESPP eligibility

Health Savings Account (HSA)

Job summary

Everforth Apex Systems seeks a Vice President, AI Infrastructure Support Engineer to lead hands-on operations for AI infrastructure, GPUs and production services. You will deploy and monitor AI/ML workloads using Kubernetes/Docker and optimize NVIDIA GPU nodes for performance and reliability.

You will automate with Ansible, Python, and shell scripts, manage incidents via JIRA/ServiceNow, and drive DevOps practices including CI/CD with GitLab.

Qualifications

• Bachelor's degree or equivalent practical experience.
• Strong experience supporting AI infrastructure, GPU platforms, or HPC environments.
• Hands-on experience with NVIDIA GPU nodes (A100, H100, B200).
• Solid understanding of Kubernetes and Docker for distributed workloads.
• Proficiency in Ansible, Python and shell scripting for automation and operations.
• Experience with DevOps practices and tools like GitLab CI/CD and container-based delivery.
• Familiarity with JIRA and ServiceNow for ticketing and ITSM.
• Knowledge of networking, Linux administration, and infrastructure troubleshooting.
• Understanding of identity and access management (Azure AD).
• Excellent written and verbal communication and ability to document processes.

Responsibilities

• Deliver operational support and drive issue resolution for AI infrastructure and GPU platforms.
• Support deployment, orchestration, and monitoring of AI/ML workloads with Kubernetes and Docker.
• Provide hands-on expertise with NVIDIA GPUs for provisioning, tuning, and ops.
• Build and maintain automation scripts using Ansible, Python, and shell scripting.
• Manage incidents, service requests, and changes via JIRA and ServiceNow.
• Collaborate with engineering, platform, and operations to implement DevOps best practices.
• Create runbooks, SOPs, and infrastructure architecture artifacts.
• Diagnose networking, storage, and system performance issues affecting AI workloads.
• Participate in rotating on-call coverage including occasional weekend shifts.

Skills

Leadership

Problem solving

Communication

Cross-functional collaboration

Documentation

Education

Bachelor's degree in Computer Science, Engineering, Information Technology, or related field

Tools

Kubernetes

Docker

Ansible

Python

Shell scripting

GitLab CI/CD

Azure AD

JIRA

ServiceNow

Job description

Job#: 3056186

Job Description: We’re seeking a future team member for the role of Vice President, AI Infrastructure Support Engineer to join our AI Infrastructure Support team. This is a hand on role for any professional looking to take ownership and lead. In this role, you’ll make an impact in the following ways:

• Deliver operational support and drive issue resolution for AI infrastructure, GPU platforms, and associated production services.
• Support the deployment, orchestration, and monitoring of AI/ML workloads across distributed environments using Kubernetes and Docker.
• Apply hands‑on expertise with NVIDIA GPU infrastructure, including A100, H100, and B200 nodes, to support provisioning, utilization, performance tuning, and ongoing platform operations.
• Build, maintain, and optimize automation scripts and tooling using Ansible, Python and Shell scripting to improve efficiency and reliability.
• Manage incidents, service requests, and change activity through enterprise workflow and ticketing platforms such as JIRA and ServiceNow.
• Partner with cross‑functional teams across engineering, platform, and operations to implement DevOps best practices, including CI/CD using GitLab, containerized deployment models, and secure access management through Azure AD.
• Create and maintain clear technical documentation, including runbooks, standard operating procedures, support guides, and infrastructure architecture artifacts.
• Diagnose and resolve networking, storage, and system performance issues affecting AI infrastructure and high‑performance compute workloads.
• Participate in a rotating on‑call support model, including occasional weekend coverage, to help maintain high availability and operational excellence.

To be successful in this role, we’re seeking the following:

• Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related field, or equivalent practical experience.
• Strong experience supporting AI infrastructure, GPU platforms, or high‑performance compute environments in enterprise or production settings.
• Hands‑on experience working with NVIDIA GPU nodes, including A100, H100, and B200 systems.
• Solid understanding of Kubernetes and Docker for deploying, managing, and troubleshooting distributed workloads.
• Proficiency in Ansible, Python and Shell scripting for automation, tooling, and operational support tasks.
• Experience with DevOps practices and tools, including GitLab CI/CD, infrastructure automation, and container‑based delivery models.
• Familiarity with enterprise ticketing and service management platforms such as JIRA and ServiceNow.
• Good knowledge of networking, storage, Linux systems administration, and infrastructure troubleshooting in complex technical environments.
• Understanding of identity and access management, including secure access controls such as Azure AD.
• Strong problem‑solving skills, attention to detail, and the ability to manage multiple priorities in a fast‑paced environment.
• Effective written and verbal communication skills, with the ability to document processes and collaborate across technical and non‑technical teams.
• Willingness to participate in on‑call rotations and provide occasional weekend support as needed.

Required Technical Environment

• Category Technologies
  • AI Infrastructure
  • AI/ML Platforms, High‑Performance Computing (HPC)
  • GPU Technologies – NVIDIA A100, H100, B200
  • Containers & Orchestration – Kubernetes, Docker
  • Automation & Scripting – Ansible, Python, Shell Scripting
  • DevOps – GitLab CI/CD, Infrastructure Automation
  • Service Management – JIRA, ServiceNow
  • Operating Systems – Linux
  • Networking & Storage
  • Infrastructure Troubleshooting, Performance Optimization
  • Identity & Access Management – Azure AD
  • Infrastructure Operations, Monitoring, Incident Management, Change Management
  • Professional Skills – Documentation, Cross‑Functional Collaboration, Problem Solving, Production Support
• Education
  • Bachelor's Degree or Equivalent Experience

Everforth Apex is a world‑class IT services company that serves thousands of clients across the globe. When you join Everforth Apex, you become part of a team that values innovation, collaboration, and continuous learning. We offer quality career resources, training, certifications, development opportunities, and a comprehensive benefits package. Our commitment to excellence is reflected in many awards, including ClearlyRated’s Best of Staffing® in Talent Satisfaction in the United States and Great Place to Work® in the United Kingdom and Mexico.

Benefits Overview

• Medical, dental, vision, life, disability, and other insurance plans that offer an optional layer of financial protection.
• ESPP (employee stock purchase program) and a 401K program which allows you to contribute typically within 30 days of starting, with a company match after 12 months of tenure.
• HSA (Health Savings Account on the HDHP plan).
• SupportLinc Employee Assistance Program (EAP) with up to 8 free counseling sessions.
• Corporate discount savings program and other discounts.
• Professional development: on‑demand training program, access to certification prep and a library of technical and leadership courses/books/seminars once you have 6+ months of tenure, certification discounts and other perks to associations that include CompTIA and IIBA.
• Dedicated customer service team for our consultants that can address questions around benefits and other resources, as well as a certified Career Coach.
• Full list of our benefits, programs, support teams and resources within our ‘Welcome Packet’.

Everforth Apex Systems is an equal opportunity employer. We do not discriminate or allow discrimination on the basis of race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. Everforth Apex will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law.

If you require an accommodation under the Americans with Disabilities Act to participate in an interview with a virtual recruiter or to use our website for a search or application, please contact our Benefits Department at [e-mail] or 804‑523‑8228. Please note that this contact information is strictly to be used for medical ADA accommodations and that no other inquiries will be answered.

UnitedHealthcare creates and publishes the Transparency in Coverage Machine‑Readable Files on behalf of Everforth Apex Systems. VEVRAA Federal Contractor. We request Priority Protected Veteran & Disabled Referrals for all of our locations within the state. PDN‑a2ffcfa1‑2968‑4757‑8f71‑476ce661f744