Senior AI Platform & Kubernetes Infrastructure Engineer

EY; Palo Alto (CA); Hybrid; USD 126,000 - 230,000; Full time

Benefits offered by this job

Hybrid work model

Medical and dental coverage

401(k) plan

Paid time off

Job summary

EY is seeking AI Systems Engineers to build and operate a foundational, cloud-native substrate powering EY’s AI-native platform. You’ll own Kubernetes, multi-tenant scaling, and cross-environment infrastructure from bare-metal to cloud, with a focus on reliability, portability, and safety in regulated client contexts.

The role spans on-prem, cloud, edge, and air-gapped environments, delivering core platform capabilities and driving automation, CI/CD, and GitOps to enable downstream teams.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related field.
• 8+ years building or operating enterprise infrastructure, cloud platforms, or large-scale Kubernetes environments.
• Hands-on with Kubernetes distributions (RKE2, EKS/AKS/GKE, K3s).
• Experience with bare-metal, cloud, hybrid, on-prem, and air-gapped deployments.
• Strong experience with GPU infrastructure and scheduling (NVAIE/DCGM).
• IaC/GitOps tooling (Terraform/OpenTofu, Helm, ArgoCD, Crossplane).
• Proven track record in regulated environments (security/compliance).
• Collaborates with security, architecture, product, and delivery teams.

Responsibilities

• Own the cluster & cloud-native platform: compute, Kubernetes, scheduling, multi-tenancy for Agentic AI workflows.
• Manage infrastructure foundation: Ubuntu/OS, bare-metal, DPU, and NVAIE provisioning.
• Stand up EY Agentic AI environments across cloud/on-prem/edge/air-gapped.
• Deliver platform capabilities: Infra Management, Kubernetes & Scheduling, Cluster Fabric.
• Own cluster lifecycle, autoscaling, GPU pooling, and multi-tenancy boundaries.
• Secure execution and inference: Ray Serve, vLLM/Triton, sandboxed hosting.
• Cognitive routing: Envoy AI Gateway, semantic routing, model/prompt selection.
• Collaborate on CI/CD/CV, IaC/GitOps (ArgoCD, Helm, Terraform/OpenTofu).
• Backup, DR, cross-environment replication; patching and hygiene.
• Ensure modular substrate to minimize vendor lock-in.

Skills

Kubernetes

Cloud-native

Automation

Security

Communication

Education

Bachelor’s or Master’s degree in Computer Science

Tools

RKE2

EKS/AKS/GKE

K3s

Terraform/OpenTofu

Helm

ArgoCD

Crossplane

Velero

Job description

EY is seeking AI Systems Engineers to build and operate a foundational, cloud-native substrate powering EY’s AI-native platform. You’ll own Kubernetes, multi-tenant scaling, and cross-environment infrastructure from bare-metal to cloud, with a focus on reliability, portability, and safety in regulated client contexts.

The role spans on-prem, cloud, edge, and air-gapped environments, delivering core platform capabilities and driving automation, CI/CD, and GitOps to enable downstream teams.