AI Infra Engineer: GPU HPC Clusters & Orchestration

THE SUPREME HR ADVISORY PTE. LTD.; Singapore; On-site; SGD 56,000 - 78,000; Full time

Job summary

THE SUPREME HR ADVISORY PTE. LTD. is seeking an AI Infrastructure Engineer to architect and operate high-density GPU clusters and distributed AI workloads. You will implement container orchestration (Kubernetes, Slurm, Ray), optimize kernel parameters, and ensure low-latency networking and fast storage for training pipelines.

You will collaborate with AI/ML teams, monitor GPU health and NCCL latency, and drive automation via Terraform and Ansible to enable reliable, scalable AI infrastructure.

Qualifications

• Bachelor's degree in CS/IT/CE or equivalent.
• 3–6+ years hands-on experience in infrastructure engineering, HPC, DevOps, or cloud infra.
• Deep Linux administration, kernel tuning, and scripting (Bash/Python).
• Strong understanding of GPU hardware architectures, CUDA runtimes, and PCIe/NVLink topologies.
• Hands-on experience with Kubernetes GPU operators and HPC schedulers (Slurm, Run:ai, Ray).
• Proven experience with RDMA (RoCE v2 /InfiniBand), PFC, ECN.
• Familiarity with high-IOPS, low-latency shared storage for AI datasets

Responsibilities

• Architect, configure, and maintain AI compute clusters.
• Implement and manage container orchestration platforms optimized for AI/ML workloads.
• Monitor GPU health, telemetry, utilization and thermals; minimize idle compute time.
• Design and optimize low-latency networks and scalable storage for AI pipelines.
• Build automated deployment pipelines using Terraform and Ansible; maintain golden images.
• Lead incident response, RCA, and disaster recovery for AI environments.

Skills

Linux administration

Kernel tuning

Shell scripting

GPU architectures

CUDA runtimes

PCIe/NVLink

Kubernetes

Slurm

Run:AI / Ray

NVIDIA HGX/DGX

RDMA / InfiniBand

Storage for AI data

Terraform

Ansible

Monitoring tooling

Education

Bachelor’s Degree in Computer Science / IT / Computer Engineering

Tools

Kubernetes GPU Operator

Slurm HPC Scheduler

Ray

Terraform

Ansible

Pulumi

nvidia-smi / CUDA toolkit

Job description

THE SUPREME HR ADVISORY PTE. LTD. is seeking an AI Infrastructure Engineer to architect and operate high-density GPU clusters and distributed AI workloads. You will implement container orchestration (Kubernetes, Slurm, Ray), optimize kernel parameters, and ensure low-latency networking and fast storage for training pipelines.

You will collaborate with AI/ML teams, monitor GPU health and NCCL latency, and drive automation via Terraform and Ansible to enable reliable, scalable AI infrastructure.