AI GPU Infra Engineer | Kubernetes & Automation

Yoh Services LLC; New York (NY); Híbrido; USD 140.000 - 170.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Medical benefits

HSA

Life & Disability Insurance

401K Retirement Savings Plan

Direct Deposit

Referral bonuses

Certification & training opportunities

Descripción de la vacante

Yoh Services LLC in New York, NY seeks an AI Infrastructure Support Engineer to drive operations for AI workloads and GPU platforms. You will implement deployment and monitoring across distributed environments using Kubernetes and Docker, with automation in Ansible and Python.

This role requires strong DevOps experience, incident management, and cross-functional collaboration. You will work in a hybrid setup (onsite and remote capabilities) with on-call rotations.

Formación

• Bachelor’s degree or equivalent practical experience.
• Experience supporting AI infrastructure, GPU platforms, or HPC in enterprise or production settings.
• Hands-on NVIDIA GPU node experience (A100, H100, B200).
• Solid Kubernetes and Docker proficiency for distributed workloads.
• Automation scripting in Ansible, Python and Shell.
• DevOps practices with GitLab CI/CD and container-based delivery.
• Familiarity with JIRA and ServiceNow ticketing.
• Strong networking, Linux admin, and infra troubleshooting skills.
• IAM knowledge, including Azure AD, and on-call readiness.

Responsabilidades

• Deliver operational support and drive issue resolution for AI infrastructure and GPU platforms.
• Support deployment, orchestration, and monitoring of AI/ML workloads with Kubernetes and Docker.
• Maintain automation tooling with Ansible, Python, and Shell scripts.
• Manage incidents, service requests, and changes via JIRA and ServiceNow.
• Collaborate across engineering and operations to implement DevOps best practices (CI/CD, containerization, secure access).
• Create clear technical runbooks, SOPs, and infrastructure architecture artifacts.
• Troubleshoot networking, storage, and performance issues on AI/HPC workloads.
• Participate in rotating on-call support, including occasional weekends.

Conocimientos

AI infrastructure support

GPU platforms

Kubernetes

Docker

Ansible

Python

GitLab CI/CD

Azure AD

Linux admin

Educación

Bachelor's degree or equivalent experience

Herramientas

Kubernetes

Docker

GitLab CI/CD

Ansible

Azure AD

Descripción del empleo

Yoh Services LLC in New York, NY seeks an AI Infrastructure Support Engineer to drive operations for AI workloads and GPU platforms. You will implement deployment and monitoring across distributed environments using Kubernetes and Docker, with automation in Ansible and Python.

This role requires strong DevOps experience, incident management, and cross-functional collaboration. You will work in a hybrid setup (onsite and remote capabilities) with on-call rotations.