Senior AI Platform Infrastructure Engineer

EY; Cincinnati (OH); On-site; USD 126,000 - 230,000; Full time

Job summary

EY is seeking AI Systems Engineers to build and operate EY’s AI-native platform across cloud, on-prem, edge, and air-gapped targets. You will own the foundational substrate, including Kubernetes, cluster fabric, and multi-tenant scaling, enabling reliable and portable AI workflows across environments.

The role demands deep engineering depth in bare-metal and GPU systems, production Kubernetes at scale, and a portability-first mindset with strong security and compliance practices.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related technical field.
• 8+ years building or operating enterprise infrastructure, cloud platforms, or large-scale Kubernetes environments.
• Hands-on expertise with Kubernetes distributions (RKE2, EKS/AKS/GKE, K3s) and full cluster lifecycle management.
• Deep experience with bare-metal, cloud, hybrid, on-prem, and ideally air-gapped deployment models.
• Strong grounding in cluster networking (Cilium/service mesh/CNI), storage, and multi-tenancy isolation.
• Experience with GPU infrastructure and scheduling (NVAIE/DCGM, GPU operators, virtualization).
• Experience with infrastructure-as-code and GitOps tooling (Terraform/OpenTofu, Helm, ArgoCD, Crossplane).
• Proven track record operating production infrastructure under compliance, security, or regulatory constraints.
• Ability to work effectively with security, architecture, product, and delivery teams.

Responsibilities

• Own the cluster & cloud-native platform: compute, Kubernetes and scheduling, cluster fabric/networking, multi-tenancy, and distributed compute.
• Own the infrastructure foundation: Ubuntu/OS, BMC/bare-metal, DPU architecture, and NVAIE (GPU/Network/DCGM).
• Stand up and manage EY Agentic AI environments across cloud, on-prem, edge, and air-gapped deployment modes.
• Deliver foundational platform capabilities such as Infrastructure Management, Kubernetes & Scheduling, and Cluster Fabric Management.
• Own cluster lifecycle, autoscaling, GPU pooling/virtualization, and multi-tenancy boundaries.
• Own secure execution and inference with sandboxed environments for model execution.
• Own cognitive and routing: Envoy AI Gateway, semantic routing, model/prompt selection, streaming handling.
• Collaborate with DevOps on CI/CD/CV, IaC/GitOps for reproducible environments.
• Own backup, disaster recovery, and cross-environment replication for high availability.
• Ensure substrate is modular and swappable to minimize vendor lock-in.

Skills

Kubernetes platforms

Cloud-native infra

Bare-metal systems

GPU infrastructure

Multi-tenancy

Infrastructure automation

Networking & CNI

Cluster lifecycle

Envoy/AI gateway

Security/compliance

Education

Bachelor’s or Master’s in CS or related field

Tools

RKE2

EKS/AKS/GKE

K3s

Terraform/OpenTofu

Helm

ArgoCD

Crossplane

Job description

EY is seeking AI Systems Engineers to build and operate EY’s AI-native platform across cloud, on-prem, edge, and air-gapped targets. You will own the foundational substrate, including Kubernetes, cluster fabric, and multi-tenant scaling, enabling reliable and portable AI workflows across environments.

The role demands deep engineering depth in bare-metal and GPU systems, production Kubernetes at scale, and a portability-first mindset with strong security and compliance practices.