Hybrid AI GPU Infrastructure Engineer

Yoh, A Day & Zimmermann Company; New York (NY); Hybrid; USD 140,000 - 170,000; Full time

Benefits offered by this job

Medical, Prescription, Dental & Vision

Health Savings Account (HSA)

Life & Disability Insurance

401K Retirement Savings Plan

Direct Deposit & weekly epayroll

Certification and training

Referral Bonus Programs

Job summary

Yoh, a Day & Zimmermann company, is seeking an AI Infrastructure Support Engineer in New York, offering hybrid work with onsite presence as needed. You will support AI infrastructure, GPU platforms, and production services, deploying and monitoring AI/ML workloads across distributed environments using Kubernetes and Docker.

Expect hands-on work with NVIDIA GPU nodes (A100/H100/B200) and automation via Ansible, Python, and Shell.

Qualifications

• Bachelor's degree in Computer Science, Engineering, Information Technology, or related field, or equivalent practical experience.
• Strong experience supporting AI infrastructure, GPU platforms, or high-performance compute environments.
• Hands-on experience with NVIDIA GPU nodes (A100, H100, B200).
• Solid Kubernetes and Docker knowledge for deploying and troubleshooting workloads.
• Automation scripting using Python and Shell.
• Experience with DevOps, CI/CD (GitLab), and container-based delivery.

Responsibilities

• Deliver operational support and drive issue resolution for AI infrastructure, GPU platforms, and production services.
• Support deployment, orchestration, and monitoring of AI/ML workloads across distributed environments using Kubernetes and Docker.
• Provision, utilize, and tune NVIDIA GPU infrastructure (A100, H100, B200) for platform operations.
• Build and maintain automation scripts with Ansible, Python, and Shell scripting.
• Manage incidents, service requests, and changes via JIRA and ServiceNow.
• Collaborate with engineering, platform, and operations teams to implement DevOps best practices, including CI/CD with GitLab.
• Create runbooks, SOPs, support guides, and infrastructure architecture artifacts.
• Diagnose networking, storage, and performance issues across AI/workloads.
• Participate in rotating on-call support, including occasional weekend coverage.

Skills

Kubernetes

Docker

NVIDIA GPUs

Python scripting

Shell scripting

GitLab CI/CD

Ansible

Azure AD

Networking

Linux admin

On-call support

Documentation

Education

Bachelor's degree in Computer Science, Engineering, IT, or related field

Tools

Kubernetes

Docker

GitLab CI/CD

Ansible

ServiceNow

JIRA

Azure AD

Job description

Yoh, a Day & Zimmermann company, is seeking an AI Infrastructure Support Engineer in New York, offering hybrid work with onsite presence as needed. You will support AI infrastructure, GPU platforms, and production services, deploying and monitoring AI/ML workloads across distributed environments using Kubernetes and Docker.

Expect hands-on work with NVIDIA GPU nodes (A100/H100/B200) and automation via Ansible, Python, and Shell.