AI Platform Infra Engineer — Kubernetes & GPU Stack

EY; San Diego (CA); Hybrid; USD 126,000 - 230,000; Full time

Benefits offered by this job

Hybrid model

Comprehensive benefits

Paid time off

Job summary

EY seeks an AI Systems Engineer to build and operate EY’s foundational AI-native platform substrate across cloud, on‑prem, edge, and air‑gapped targets. You will own Kubernetes, multi‑tenancy, GPU scheduling, and secure execution for scalable Agentic AI workflows.

The role demands deep expertise in cloud-native infra, advanced networking, and infrastructure-as-code, with a focus on reliability, portability, and risk management in regulated client contexts.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related technical field.
• 8+ years building or operating enterprise infrastructure or large-scale Kubernetes environments.
• Hands‑on with Kubernetes distributions (RKE2, EKS/AKS/GKE, K3s).
• Experience with bare‑metal, cloud, hybrid, on‑prem, air‑gapped deployment models.
• Strong grounding in cluster networking (Cilium/CNI), storage, and multi‑tenancy isolation.
• Experience with GPU infrastructure and scheduling (NVAIE/DCGM, virtualization).
• Experience with infrastructure‑as‑code and GitOps tooling (Terraform/OpenTofu, Helm, ArgoCD, Crossplane).
• Proven track record operating production infrastructure under compliance or regulatory constraints.
• Ability to work with security, architecture, product, and delivery teams.

Responsibilities

• Own the cluster & cloud-native platform including compute, Kubernetes, and scheduling.
• Own the infrastructure foundation (Ubuntu/OS, bare-metal, DPU architecture).
• Stand up and manage EY Agentic AI environments across cloud, on‑prem, edge, and air-gapped targets.
• Deliver platform capabilities so downstream runtime, data, and execution services run safely and consistently.
• Own cluster lifecycle, autoscaling, GPU pooling, and multi-tenancy boundaries.
• Own secure execution and inference with sandboxed execution for model safety.
• Own cognitive and routing: Envoy AI Gateway, semantic routing, model/prompt selection.
• Collaborate with DevOps on CI/CD/GitOps to ensure reproducible environments.
• Own backup, disaster recovery, and cross-environment replication for high availability.

Skills

Kubernetes

Cloud-native

Multi-tenancy

GPU infra

CI/CD

GitOps

Cluster lifecycle

Security/compliance

Envoy AI Gateway

Education

Bachelor’s or Master’s in CS or related field

Tools

RKE2

EKS

AKS

GKE

K3s

ArgoCD

Terraform/OpenTofu

Helm

Crossplane

Velero/Cilium

Job description

EY seeks an AI Systems Engineer to build and operate EY’s foundational AI-native platform substrate across cloud, on‑prem, edge, and air‑gapped targets. You will own Kubernetes, multi‑tenancy, GPU scheduling, and secure execution for scalable Agentic AI workflows.

The role demands deep expertise in cloud-native infra, advanced networking, and infrastructure-as-code, with a focus on reliability, portability, and risk management in regulated client contexts.