AI Platform Infra Engineer — Kubernetes & GPUs

EY; Cleveland (OH); Hybrid; USD 126,000 - 230,000; Full time

Benefits offered by this job

Medical and dental coverage

401(k) and pension plans

Paid time off

Job summary

EY is seeking AI Systems Engineers to build and operate the foundational substrate for EY's AI-native platform. You will own the cloud-native platform across Kubernetes, multi-tenancy, and hybrid deployments, enabling scalable, secure model execution in regulated client contexts.

The role requires deep infrastructure depth, experience with GPU and bare-metal systems, and a portfolio of IaC/GitOps practices to ensure reliability and portability across cloud, on-prem, edge, and air-gapped

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related technical field.
• 8+ years building or operating enterprise infrastructure, cloud platforms, or large-scale Kubernetes environments.
• Hands-on experience with Kubernetes distributions (RKE2, EKS/AKS/GKE, K3s) and full cluster lifecycle management.
• Deep experience with bare-metal, cloud, hybrid, on-prem, and air-gapped deployment models.
• Strong grounding in cluster networking, storage, and multi-tenancy isolation.
• Experience with GPU infrastructure and scheduling (NVAIE/DCGM, GPU operators, virtualization/MIG).
• Experience with infrastructure-as-code and GitOps tooling (Terraform/OpenTofu, Helm, ArgoCD, Crossplane).
• Proven track record operating production infrastructure under compliance, security, or regulatory constraints.
• Ability to work effectively with security, architecture, product, and delivery teams.

Responsibilities

• Own the cluster & cloud-native platform: compute, Kubernetes, scheduling, cluster fabric/networking, multi-tenancy.
• Own the infrastructure foundation: Ubuntu/OS, bare-metal, DPU architecture, and NVAIE provisioning and patching.
• Stand up EY Agentic AI environments across cloud, on-prem, edge, and air-gapped deployment modes.
• Deliver foundational platform capabilities such as Infrastructure Management, Kubernetes & Scheduling, and Cluster Fabric Management.
• Own cluster lifecycle, autoscaling, GPU pooling/virtualization, and tenancy boundaries.
• Own secure execution and inference with Ray Serve, vLLM/NIM/Triton, sandboxed execution.
• Own cognitive and routing: Envoy AI Gateway, semantic routing, model/prompt selection.
• Collaborate with DevOps on CI/CD/CV and GitOps for reproducible environments.
• Own backup, disaster recovery, and cross-environment replication, plus patching and supply-chain hygiene.
• Ensure the substrate is modular and swappable to minimize vendor lock-in.

Skills

Kubernetes

Bare-metal

GPU infrastructure

Multi-tenancy

Cloud platforms

Infrastructure-as-code

GitOps

CI/CD

Security & compliance

Communication

Education

Bachelor’s or Master’s degree in Computer Science or related technical field

Tools

EKS/AKS/GKE

RKE2

K3s

ArgoCD

Terraform/OpenTofu

Helm

Crossplane

Karpenter

Velero

Cilium

Job description

EY is seeking AI Systems Engineers to build and operate the foundational substrate for EY's AI-native platform. You will own the cloud-native platform across Kubernetes, multi-tenancy, and hybrid deployments, enabling scalable, secure model execution in regulated client contexts.

The role requires deep infrastructure depth, experience with GPU and bare-metal systems, and a portfolio of IaC/GitOps practices to ensure reliability and portability across cloud, on-prem, edge, and air-gapped