AI Platform Infrastructure Engineer

EY; New York (NY); On-site; USD 126,000 - 230,000; Full time

Benefits offered by this job

Hybrid work model

Total Rewards package

Medical and dental coverage

Pension and 401(k) plans

Paid time off options

Job summary

EY seeks an AI Systems Engineer to build and operate the foundational substrate powering EY's AI-native platform. You’ll own the hardware-to-Kubernetes stack, manage cloud/on‑prem/edge environments, and ensure reliability and portability for regulated client contexts.

This leader will drive infrastructure automation, multi-tenant isolation, and secure execution models across diverse targets while collaborating with security, architecture, and product teams.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related technical field.
• 8+ years building or operating enterprise infrastructure, cloud platforms, or large-scale Kubernetes environments, including hands-on systems depth.
• Hands‑on expertise with Kubernetes distributions (RKE2, EKS/AKS/GKE, K3s) and full cluster lifecycle management.
• Deep experience with bare‑metal, cloud, hybrid, on‑prem, and ideally air‑gapped deployment models.
• Strong grounding in cluster networking (Cilium/service mesh/CNI), storage, and multi‑tenancy isolation.
• Experience with GPU infrastructure and scheduling (NVAIE/DCGM, GPU operators, virtualization/MIG).
• Experience with infrastructure‑as‑code and GitOps tooling (Terraform/OpenTofu, Helm, ArgoCD, Crossplane).
• Proven track record operating production infrastructure under compliance, security, or regulatory constraints.
• Ability to work effectively with security, architecture, product, and delivery teams.

Responsibilities

• Own the cluster & cloud-native platform: compute, Kubernetes and scheduling, cluster fabric/networking, multi-tenancy, and distributed compute.
• Own the infrastructure foundation: Ubuntu/OS, BMC/bare-metal, DPU architecture, and NVAIE (GPU/Network/DCGM).
• Stand up and manage EY Agentic AI environments across cloud, on-prem, edge, and air-gapped deployment modes, maintaining a consistent stack across targets.
• Deliver foundational platform capabilities such as Infrastructure Management, Kubernetes & Scheduling, and Cluster Fabric Management.
• Own cluster lifecycle, autoscaling, GPU pooling/virtualization, and multi-tenancy boundaries for isolated capacity per tenant.
• Own secure execution and inference with Ray Serve, vLLM/NIM/Triton, and NVIDIA Dynamo in sandboxed environments.
• Own cognitive and routing: Envoy AI Gateway, semantic routing, model/prompt selection, and streaming response handling.
• Collaborate with DevOps on CI/CD/CV, IaC/GitOps (Helm/OpenTofu), ensuring reproducible environments.
• Own backup, disaster recovery, and cross-environment replication with Velero, CloudNativePG, and Cilium ClusterMesh.
• Ensure modular, swappable substrate to minimize vendor lock-in while preserving stack contracts.

Skills

Kubernetes

Cloud-native platforms

Multi-tenancy

Bare-metal

GPU infrastructure

CI/CD / GitOps

Terraform/OpenTofu

ArgoCD

Crossplane

Education

Bachelor’s or Master’s degree in Computer Science or related technical field

Tools

RKE2

EKS/AKS/GKE

K3s

Job description

EY seeks an AI Systems Engineer to build and operate the foundational substrate powering EY's AI-native platform. You’ll own the hardware-to-Kubernetes stack, manage cloud/on‑prem/edge environments, and ensure reliability and portability for regulated client contexts.

This leader will drive infrastructure automation, multi-tenant isolation, and secure execution models across diverse targets while collaborating with security, architecture, and product teams.