Senior AI Platform Infrastructure Engineer

Ernst & Young Advisory Services Sdn Bhd; Atlanta (GA); Hybrid; USD 126,000 - 262,000; Full time

Benefits offered by this job

Hybrid work model

Competitive compensation

Total Rewards package (medical, dental

401(k) plan

Job summary

Ernst & Young Advisory Services Sdn Bhd seeks an AI Systems Engineer to design and operate the foundational substrate powering EY’s AI-native platform. You will own the cloud-native platform, bare-metal to Kubernetes, across cloud, on-prem, edge, and air-gapped targets, ensuring reliability and portability for AI workloads.

The role requires deep infrastructure expertise, governance in regulated environments, and collaboration with DevOps and security teams to deliver reusable platform

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related field (required).
• 8+ years building enterprise infrastructure and large-scale Kubernetes environments.
• Experience with GPU infrastructure and operating in regulated environments.

Responsibilities

• Own the cluster & cloud-native platform: compute, Kubernetes and scheduling, cluster fabric/networking, multi-tenancy, and distributed compute for Agentic AI workflows.
• Own the infrastructure foundation: Ubuntu/OS, BMC/bare-metal, DPU architecture, and NVAIE (GPU/Network/DCGM).
• Stand up and manage EY Agentic AI environments across cloud, on-prem, edge, and air-gapped deployment modes.
• Deliver foundational platform capabilities such as Infrastructure Management, Kubernetes & Scheduling, and Cluster Fabric Management.
• Own cluster lifecycle, autoscaling, GPU pooling/virtualization, and multi-tenancy boundaries.
• Own secure execution and inference with Ray Serve, vLLM/NIM/Triton, and NVIDIA Dynamo.
• Own cognitive and routing with Envoy AI Gateway and model/prompt selection.
• Collaborate with DevOps on CI/CD/CV, IaC/GitOps to ensure reproducibility.
• Own backup, disaster recovery, and cross-environment replication.
• Ensure the substrate is modular and swappable to minimize vendor lock-in.

Skills

Kubernetes at scale

Multi-tenancy

Bare-metal infrastructure

GPU infrastructure

Infra-as-code

GitOps automation

Security & compliance

Strong communication

Education

Bachelor’s or Master’s degree in Computer Science or related technical field

Tools

Terraform/OpenTofu

Helm

ArgoCD

Crossplane

Job description

Ernst & Young Advisory Services Sdn Bhd seeks an AI Systems Engineer to design and operate the foundational substrate powering EY’s AI-native platform. You will own the cloud-native platform, bare-metal to Kubernetes, across cloud, on-prem, edge, and air-gapped targets, ensuring reliability and portability for AI workloads.

The role requires deep infrastructure expertise, governance in regulated environments, and collaboration with DevOps and security teams to deliver reusable platform