Senior AI Platform Infrastructure Engineer

EY; Columbus (OH); Hybrid; USD 126,000 - 230,000; Full time

Job summary

EY is seeking AI Systems Engineers to build and operate EY’s AI-native platform substrate, spanning bare-metal to Kubernetes across cloud, on‑prem, edge and air‑gapped targets. You will own the cluster, platform fabric, and multi‑tenancy to support scalable, safe model execution.

You’ll lead infrastructure foundations, from Ubuntu and GPU hardware to CI/CD, GitOps, and orchestration with Ray Serve and NVAIE, delivering a portable, compliant substrate that accelerates EY’s Agentic AI capabilities.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related technical field.
• 8+ years building or operating enterprise infrastructure and large-scale Kubernetes.
• Hands-on experience with Kubernetes distributions (RKE2, EKS/AKS/GKE, K3s).
• Deep experience with bare-metal, cloud, hybrid, on-prem, and air-gapped deployment models.
• Strong grounding in cluster networking, storage, and multi-tenancy isolation.
• Experience with GPU infrastructure and scheduling (NVAIE/DCGM).

Responsibilities

• Own the cluster & cloud-native platform: compute, Kubernetes and scheduling, cluster fabric, multi-tenancy.
• Own the infrastructure foundation: Ubuntu/OS, BMC/bare-metal, DPU architecture, and NVAIE (GPU/Network/DCGM).
• Stand up and manage EY Agentic AI environments across cloud, on-prem, edge, and air-gapped modes.
• Deliver foundational platform capabilities such as Infrastructure Management, Kubernetes & Scheduling, and Cluster Fabric Management.
• Own cluster lifecycle, autoscaling, GPU pooling/virtualization, and multi-tenancy boundaries.
• Own secure execution and inference with Ray Serve, vLLM/NIM/Triton, sandboxed execution.
• Own cognitive and routing: Envoy AI Gateway, semantic routing, model/prompt selection, and streaming handling.
• Collaborate with DevOps on deployment and delivery of the platform itself: CI/CD/CV, GitOps.
• Own backup, disaster recovery, and cross-environment replication; patching and supply-chain hygiene.
• Ensure the substrate is modular and swappable to minimize vendor lock-in.

Skills

Kubernetes

Cloud platforms

Multi-tenancy

Bare-metal

GPU infrastructure

GitOps

Terraform

ArgoCD

Crossplane

Networking

Education

Bachelor’s or Master’s degree in Computer Science or related technical field

Tools

RKE2

EKS

AKS

GKE

K3s

NVAIE

DCGM

vCluster

Crossplane

Job description

EY is seeking AI Systems Engineers to build and operate EY’s AI-native platform substrate, spanning bare-metal to Kubernetes across cloud, on‑prem, edge and air‑gapped targets. You will own the cluster, platform fabric, and multi‑tenancy to support scalable, safe model execution.

You’ll lead infrastructure foundations, from Ubuntu and GPU hardware to CI/CD, GitOps, and orchestration with Ray Serve and NVAIE, delivering a portable, compliant substrate that accelerates EY’s Agentic AI capabilities.