AI Infrastructure Engineer — GPU & DevOps (Hybrid)

Yoh Services LLC; Florida; Hybrid; USD 98,000 - 140,000; Full time

Benefits offered by this job

Medical & Vision Benefits

Health Savings Account (HSA)

Life & Disability Insurance

MetLife Voluntary Benefits

Employee Assistance Program (EAP)

401K Retirement Savings Plan

Direct Deposit & weekly epayroll

Referral Bonus Programs

Certification and trainingopportunites

Job summary

Yoh Services LLC in Lake Mary, FL is seeking an AI Infrastructure Support Engineer for a hybrid role. You’ll support AI infrastructure, GPU platforms, and production services, using Kubernetes and Docker for orchestration and monitoring.

You will work with NVIDIA GPU nodes (A100, H100, B200), develop automation with Ansible, Python and Shell scripts, and collaborate on DevOps with GitLab CI/CD, Azure AD, Jira and ServiceNow. On-call rotation included.

Qualifications

• Bachelor-level degree or equivalent practical experience.
• Experience supporting AI infrastructure, GPU platforms, or HPC environments.
• Hands-on with NVIDIA GPU nodes (A100, H100, B200).
• Strong knowledge of Kubernetes and Docker for distributed workloads.
• Automation skills with Ansible, Python and shell scripting.
• Familiar with GitLab CI/CD and container-based delivery models.
• Experience with JIRA and ServiceNow for ticketing.
• Solid networking, storage, and Linux administration basics.
• Understanding of identity and access management, e.g., Azure AD.

Responsibilities

• Deliver operational support and drive issue resolution for AI infrastructure and production services.
• Support deployment, orchestration, and monitoring of AI/ML workloads across environments.
• Apply hands-on GPU infrastructure knowledge to provisioning, utilization, and tuning.
• Build and optimize automation scripts with Ansible, Python and Shell.
• Manage incidents and changes via JIRA and ServiceNow ITSM processes.
• Collaborate with cross-functional teams to implement DevOps practices and CI/CD.
• Create runbooks, SOPs, and infrastructure architecture documents.
• Diagnose networking, storage, and system performance issues.
• Participate in rotating on-call coverage, including some weekends.

Skills

Kubernetes

Docker

NVIDIA GPU infrastructure

Ansible

Python

Shell scripting

GitLab CI/CD

Azure AD

JIRA

ServiceNow

Linux administration

Networking

Storage

On-call support

Education

Bachelor’s degree in Computer Science, Engineering, Information Technology, or related field

Tools

NVIDIA GPUs (A100, H100, B200)

GitLab

Jira & ServiceNow

Azure AD

Job description

Yoh Services LLC in Lake Mary, FL is seeking an AI Infrastructure Support Engineer for a hybrid role. You’ll support AI infrastructure, GPU platforms, and production services, using Kubernetes and Docker for orchestration and monitoring.

You will work with NVIDIA GPU nodes (A100, H100, B200), develop automation with Ansible, Python and Shell scripts, and collaborate on DevOps with GitLab CI/CD, Azure AD, Jira and ServiceNow. On-call rotation included.