Scalable AI Platform Engineer - Kubernetes & GPU Infra

Nyu Langone Hospitals; New York (NY); Hybrid; USD 151,000 - 262,000; Full time

Benefits offered by this job

Hybrid work model

Medical and dental coverage

401(k) / Pension

Job summary

EY seeks AI Systems Engineers to build and operate the foundational substrate for EY’s AI-native platform. You’ll own the cloud-native stack across hybrid environments and drive reliability, portability, and safety in regulated client contexts.

You’ll manage bare-metal and GPU infrastructure, Kubernetes at scale, and cross-environment deployment, while collaborating with security, architecture, and delivery teams to keep the platform modular and production-ready.

Qualifications

• 8+ years building or operating enterprise infrastructure, cloud platforms, or large-scale Kubernetes environments.
• Hands-on expertise with Kubernetes distributions (RKE2, EKS/AKS/GKE, K3s) and full cluster lifecycle management.
• Deep experience with bare-metal, cloud, hybrid, on-prem, and ideally air-gapped deployment models.
• Strong grounding in cluster networking, storage, and multi-tenancy isolation.
• Experience with GPU infrastructure and scheduling (NVAIE/DCGM, GPU operators).
• Experience with infrastructure-as-code and GitOps tooling (Terraform/OpenTofu, Helm, ArgoCD, Crossplane).
• Proven track record operating production infrastructure under compliance, security, or regulatory constraints.

Responsibilities

• Own the cluster & cloud-native platform: compute, Kubernetes, scheduling, multi-tenancy, and distributed compute.
• Own the infrastructure foundation: Ubuntu/OS, BMC/bare-metal, DPU architecture, and NVAIE.
• Stand up and manage EY Agentic AI environments across cloud/on-prem/edge/air-gapped modes.
• Deliver foundational platform capabilities such as Infrastructure Management, Kubernetes & Scheduling, and Cluster Fabric Management.
• Own cluster lifecycle, autoscaling, GPU pooling/virtualization, and tenancy boundaries.
• Own secure execution and inference: Ray Serve, vLLM/NIM/Triton with sandboxed execution.
• Own cognitive and routing: Envoy AI Gateway, semantic routing, model/prompt selection.
• Collaborate with DevOps on CI/CD/CV, IaC/GitOps, etc. for reproducible environments.
• Own backup, disaster recovery, and cross-environment replication; ensure modular stack and low vendor lock-in.

Skills

Cloud-native platform engineering

Kubernetes

Multi-tenancy at scale

Automation & IaC

Security & compliance

Communications

Product ownership

Education

Bachelor's or Master's in Computer Science or related field

Tools

RKE2

EKS

AKS

GKE

K3s

Terraform

OpenTofu

Helm

ArgoCD

Crossplane

Job description

EY seeks AI Systems Engineers to build and operate the foundational substrate for EY’s AI-native platform. You’ll own the cloud-native stack across hybrid environments and drive reliability, portability, and safety in regulated client contexts.

You’ll manage bare-metal and GPU infrastructure, Kubernetes at scale, and cross-environment deployment, while collaborating with security, architecture, and delivery teams to keep the platform modular and production-ready.