Senior AI Infrastructure Engineer - GPU & Kubernetes

HCL Technologies Limited; California (MO); On-site; USD 120,000 - 180,000; Full time

Benefits offered by this job

401(k) retirement plan

Paid time off (PTO)

Paid holidays

Medical, dental, vision insurance

Job summary

HCL Technologies Limited is seeking an experienced AI Infrastructure Engineer (L3) to design, deploy, optimize, and support high-performance GPU-based AI infrastructure. You will manage large GPU clusters, support AI training/inference workloads, and drive platform reliability.

Applicants should have deep expertise in NVIDIA GPU platforms, Kubernetes, HPC environments, and cloud-native AI technologies. Collaboration with cloud, data science, and SRE teams is essential.

Qualifications

• Bachelor's degree in CS/Engineering or related field.
• 8-12 years of infrastructure/platform engineering experience.
• 4-6 years supporting AI/ML environments and GPU-based platforms.
• Experience operating production-scale AI infrastructure.

Responsibilities

• Deploy and manage NVIDIA GPU infrastructure and AI accelerator platforms.
• Administer Kubernetes GPU clusters with NVIDIA GPU Operator.
• Install CUDA, cuDNN, TensorRT, firmware and drivers.
• Manage Ceph, Lustre, BeeGFS, and NFS storage.
• Support InfiniBand, RDMA, RoCE, NVLink and other high-speed networking.
• Optimize Linux environments for AI and HPC workloads.
• Support Kubeflow, MLflow, Ray, and Slurm.
• Implement infrastructure as code with Terraform, Helm, and GitOps.
• Monitor with Prometheus, Grafana, NVIDIA DCGM and OpenTelemetry.
• Lead RCA and resolve GPU, networking, storage, and platform issues.
• Collaborate with cloud, data science, MLOps, SRE, and engineering teams.

Skills

NVIDIA GPU platforms

GPU cluster administration

Kubernetes & cloud-native tech

CUDA & TensorRT

Distributed training frameworks

Linux performance tuning

Terraform & Helm

ArgoCD & automation

MLOps & AI infra

Troubleshooting & production support

Education

Bachelor's Degree in CS/Engineering or related field

Tools

NVIDIA GPU Operator

Ceph

Lustre

BeeGFS

NFS

Prometheus

Grafana

OpenTelemetry

Kubeflow

MLflow

Ray

Slurm

GitOps tools

Terraform

Helm

Job description

HCL Technologies Limited is seeking an experienced AI Infrastructure Engineer (L3) to design, deploy, optimize, and support high-performance GPU-based AI infrastructure. You will manage large GPU clusters, support AI training/inference workloads, and drive platform reliability.

Applicants should have deep expertise in NVIDIA GPU platforms, Kubernetes, HPC environments, and cloud-native AI technologies. Collaboration with cloud, data science, and SRE teams is essential.