AI Platform Infrastructure Lead

EY; Jericho (NY); Hybrid; USD 151,000 - 262,000; Full time

Benefits offered by this job

Total Rewards program

Hybrid work model

Flexible vacation policy

Medical and dental coverage

Pension and 401(k)

Job summary

EY seeks AI Systems Engineers to build and operate the foundational substrate powering EY’s AI-native platform. You will manage cloud-native layers across hybrid environments from bare-metal to Kubernetes, delivering a portable and reliable substrate for Agentic AI workflows.

You will own cluster lifecycle, secure execution, and integration with CI/CD with GitOps. A Bachelor’s/Master’s in CS and 8+ years of infra experience are expected, with hands-on Kubernetes and diverse deployment models.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related technical field.
• 8+ years building or operating enterprise infrastructure, cloud platforms, or large-scale Kubernetes environments.
• Hands-on expertise with Kubernetes distributions (RKE2, EKS/AKS/GKE, K3s) and full cluster lifecycle management.
• Deep experience with bare-metal, cloud, hybrid, on-prem, and ideally air-gapped deployment models.
• Strong grounding in cluster networking (Cilium/service mesh/CNI), storage, and multi-tenancy isolation.
• Experience with GPU infrastructure and scheduling (NVAIE/DCGM, GPU operators, virtualization/MIG).
• Experience with infrastructure-as-code and GitOps tooling (Terraform/OpenTofu, Helm, ArgoCD, Crossplane).
• Proven track record operating production infrastructure under compliance, security, or regulatory constraints.
• Ability to work effectively with security, architecture, product, and delivery teams.

Responsibilities

• Own the cluster & cloud-native platform: compute, Kubernetes and scheduling, cluster fabric/networking, multi-tenancy, and distributed compute.
• Own the infrastructure foundation: Ubuntu/OS, BMC/bare-metal, DPU architecture, and NVAIE (GPU/Network/DCGM).
• Stand up and manage EY Agentic AI environments across cloud (EKS/AKS/GKE), on-prem AI Factory (RKE2/NVAIE), edge (K3s), and air-gapped deployment modes.
• Deliver foundational platform capabilities such as Infrastructure Management, Kubernetes & Scheduling, and Cluster Fabric Management.
• Own cluster lifecycle, autoscaling, GPU pooling/virtualization, and multi-tenancy boundaries.
• Own secure execution and inference: Ray Serve, vLLM/NIM/Triton, and NVIDIA Dynamo with sandboxed execution.
• Own cognitive and routing: Envoy AI Gateway, semantic routing, model/prompt selection, and streaming response handling.
• Collaborate with DevOps on CI/CD/CV, IaC/GitOps to keep environments reproducible and drift-free.
• Own backup, disaster recovery, and cross-environment replication with patching and supply-chain hygiene.
• Ensure the substrate is modular and swappable to minimize vendor lock-in.

Skills

Kubernetes

Cloud infrastructure

Multi-tenancy at scale

Automation / IaC

GPU infrastructure

Security & compliance

Communication

Platform ownership

Education

Bachelor’s or Master’s degree in Computer Science

Tools

Terraform/OpenTofu

Helm

ArgoCD

Crossplane

K3s/RKE2

Job description

EY seeks AI Systems Engineers to build and operate the foundational substrate powering EY’s AI-native platform. You will manage cloud-native layers across hybrid environments from bare-metal to Kubernetes, delivering a portable and reliable substrate for Agentic AI workflows.

You will own cluster lifecycle, secure execution, and integration with CI/CD with GitOps. A Bachelor’s/Master’s in CS and 8+ years of infra experience are expected, with hands-on Kubernetes and diverse deployment models.