AI Infrastructure Engineer: GPU, Kubernetes & MLOps

iSoftStone; Kuala Lumpur; On-site; MYR 60,000 - 100,000; Full time

Job summary

iSoftStone is seeking an AI Infrastructure Engineer in Kuala Lumpur to build and operate large-scale GPU AI infra, including AWS cloud environments and GPU Kubernetes clusters. You will optimize resource usage, support ML workloads, and drive automation.

The role requires Python programming, Linux, Docker, Kubernetes, and cloud experience (preferably AWS). English and Chinese language skills are essential for global collaboration and project success.

Qualifications

• Bachelor’s degree as listed in requirements.
• Minimum 1 year of relevant AI infrastructure related experience.
• Proficiency in English and Chinese for global collaboration.
• Strong Python or backend development language experience.
• Practical experience with Linux, Docker, and Kubernetes (K8s).
• Hands-on experience with cloud platforms, preferably AWS.
• Solid experience with AI model training, inference deployment, or ML production environments.
• Experience with PyTorch, DeepSpeed, Megatron, and vLLM is preferred.
• Understanding of LLM training/inference workflows and distributed training concepts.
• Experience with GPU computing environments, resource scheduling, or AI infrastructure operations is a plus.

Responsibilities

• Operate and maintain GPU-based AI infrastructure including AWS and bare-metal GPU Kubernetes clusters.
• Support GPU cluster deployment, configuration, monitoring, capacity management, troubleshooting, and incident resolution.
• Optimize GPU resource utilization and workload scheduling for efficiency.
• Develop tools for AI computing resource management, scheduling, monitoring, and automation.
• Support ML teams in deploying AI model training and inference workloads.
• Troubleshoot end-to-end ML workflows from data preparation to model serving.
• Collaborate across teams to ensure scalable AI infrastructure.

Skills

Python programming

Linux

Docker

Kubernetes

Cloud platforms (AWS)

English and Chinese

AI/ML workflows

Education

Bachelor’s degree in Computer Science / Software Engineering / Artificial Intelligence

Tools

Docker

Kubernetes (K8s)

AWS

Job description

iSoftStone is seeking an AI Infrastructure Engineer in Kuala Lumpur to build and operate large-scale GPU AI infra, including AWS cloud environments and GPU Kubernetes clusters. You will optimize resource usage, support ML workloads, and drive automation.

The role requires Python programming, Linux, Docker, Kubernetes, and cloud experience (preferably AWS). English and Chinese language skills are essential for global collaboration and project success.