AI Platform Infra Lead - Kubernetes, GPUs & Hybrid Cloud

EY; Alpharetta (GA); On-site; USD 126,000 - 230,000; Full time

Benefits offered by this job

Hybrid work model

Medical coverage

401(k) plan

Paid time off

Job summary

EY is seeking AI Systems Engineers to design and operate the foundational, cloud-native platform for EY’s AI-native HA I platform. You will own compute, Kubernetes, multi-tenant fabric, and the substrate powering Agentic AI workloads across cloud, on‑prem, edge, and air-gapped targets.

You will lead platform capabilities, reliability, portability, and governance, while collaborating with security, architecture, and product teams to deliver scalable, compliant infrastructure.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or a related technical field.
• 8+ years building or operating enterprise infrastructure, cloud platforms, or large-scale Kubernetes environments.
• Hands-on experience with Kubernetes distributions (RKE2, EKS/AKS/GKE, K3s) and full cluster lifecycle management.
• Deep experience with bare-metal, cloud, hybrid, on-prem, and ideally air-gapped deployment models.
• Strong grounding in cluster networking (Cilium/Service Mesh/CNI) and multi-tenancy isolation.
• Experience with GPU infrastructure and scheduling (NVAIE/DCGM, GPU operators, virtualization).
• Experience with infrastructure-as-code and GitOps tooling (Terraform/OpenTofu, Helm, ArgoCD, Crossplane).
• Proven track record operating production infrastructure under compliance, security, or regulatory constraints.

Responsibilities

• Own the cluster & cloud-native platform: compute, Kubernetes, scheduling, multi-tenancy, and clustering fabric.
• Own the infrastructure foundation: Ubuntu/OS, BMC/bare-metal, DPU architecture, NVAIE for GPU/Networking.
• Stand up and manage EY Agentic AI environments across cloud, on-prem, edge, and air-gapped targets.
• Deliver platform capabilities such as Infrastructure Management, Kubernetes & Scheduling, and Cluster Fabric Management.
• Own cluster lifecycle, autoscaling, GPU pooling/virtualization, and tenancy boundaries.
• Own secure execution and inference with Ray Serve, vLLM/NIM/Triton in sandboxed environments.
• Own cognitive routing: Envoy AI Gateway, semantic routing, and model/prompt selection.
• Collaborate on CI/CD/CV, GitOps, and IaC to ensure reproducible environments.
• Own backup, disaster recovery, and cross-environment replication for high availability.
• Ensure substrate is modular and swappable to minimize vendor lock-in.

Skills

Kubernetes

Multi-tenancy

Bare-metal GPU

Cluster lifecycle

CI/CD GitOps

Security & compliance

Education

Bachelor’s or Master’s in Computer Science or related field

Tools

RKE2

EKS/AKS/GKE

K3s

Job description

EY is seeking AI Systems Engineers to design and operate the foundational, cloud-native platform for EY’s AI-native HA I platform. You will own compute, Kubernetes, multi-tenant fabric, and the substrate powering Agentic AI workloads across cloud, on‑prem, edge, and air-gapped targets.

You will lead platform capabilities, reliability, portability, and governance, while collaborating with security, architecture, and product teams to deliver scalable, compliant infrastructure.