Senior AI Platform Infra Engineer

EY; New Brunswick (NJ); On-site; USD 126,000 - 230,000; Full time

Benefits offered by this job

Medical and dental coverage

Pension & 401(k)

Paid time off

Job summary

EY seeks an AI Systems Engineer to build and operate the foundational substrate powering EY’s AI-native platform. You’ll own the cloud-native platform layers from bare-metal through Kubernetes, delivering a portable, reliable substrate for Agentic AI workflows across cloud, on‑prem, edge, and air-gapped targets.

You’ll lead infrastructure foundation, multi-tenancy, and secure execution, enabling downstream runtime, data, and services to run safely and efficiently with reproducible environments

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related field.
• 8+ years building or operating enterprise infrastructure, cloud platforms, or large-scale Kubernetes environments.
• Hands-on experience with Kubernetes distributions (RKE2, EKS/AKS/GKE, K3s).
• Experience across bare-metal, cloud, hybrid, on-prem, and air-gapped deployment models.
• Strong grounding in cluster networking, storage, and multi-tenancy isolation.
• Experience with GPU infrastructure and scheduling (NVAIE/DCGM).
• Experience with infrastructure-as-code and GitOps tooling (Terraform/OpenTofu, Helm, ArgoCD, Crossplane).
• Proven track record operating production infrastructure under compliance and security constraints.

Responsibilities

• Own the cluster & cloud-native platform: compute, Kubernetes and scheduling, cluster fabric/networking, multi-tenancy, and distributed compute.
• Own the infrastructure foundation: Ubuntu/OS, BMC/bare-metal, DPU architecture, and NVAIE (GPU/Network/DCGM).
• Stand up and manage EY Agentic AI environments across cloud, on-prem AI Factory, edge, and air-gapped deployment modes.
• Deliver foundational platform capabilities such as Infrastructure Management, Kubernetes & Scheduling, and Cluster Fabric Management.
• Own cluster lifecycle, autoscaling, GPU pooling/virtualization, and multi-tenancy boundaries.
• Own secure execution and inference: Ray Serve, vLLM/NIM/Triton, with sandboxed execution for safety.
• Own cognitive and routing: Envoy AI Gateway, semantic routing, model/prompt selection, and streaming response handling.
• Collaborate with DevOps on CI/CD/CV, IaC/GitOps, to keep environments reproducible and drift-free.
• Own backup, disaster recovery, and cross-environment replication with patching and supply-chain hygiene.

Skills

Cloud-native platform engineering

Kubernetes at scale

Multi-tenancy at scale

Infrastructure as code

Education

Bachelor's or Master’s degree in Computer Science or related field

Tools

RKE2

EKS/AKS/GKE

K3s

Terraform/OpenTofu

Helm

ArgoCD

Crossplane

Job description

EY seeks an AI Systems Engineer to build and operate the foundational substrate powering EY’s AI-native platform. You’ll own the cloud-native platform layers from bare-metal through Kubernetes, delivering a portable, reliable substrate for Agentic AI workflows across cloud, on‑prem, edge, and air-gapped targets.

You’ll lead infrastructure foundation, multi-tenancy, and secure execution, enabling downstream runtime, data, and services to run safely and efficiently with reproducible environments