Senior AI Platform Engineer: Kubernetes & Hybrid Infra

EY; Jacksonville (FL); On-site; USD 126,000 - 262,000; Full time

Benefits offered by this job

Hybrid model

Medical and dental coverage

401(k) plan

Paid time off

Job summary

EY is seeking AI Systems Engineers to build and operate the foundational substrate powering EY’s AI-native platform. You’ll own the infrastructure and cloud-native layers from bare-metal to Kubernetes, managing EY Fabric environments across cloud, on-prem, edge, and air-gapped targets.

This role suits a full-stack infrastructure leader focused on reliability, portability, and regulated client contexts, with an emphasis on scalable, secure, and production-ready platforms that enable downstream AI

Qualifications

• 8+ years building or operating enterprise infrastructure, cloud platforms, or large-scale Kubernetes environments.
• Hands-on with Kubernetes distributions (RKE2, EKS/AKS/GKE, K3s) and full cluster lifecycle management.
• Experience with bare-metal, cloud, hybrid, on-prem, and ideally air-gapped deployment models.
• Strong grounding in cluster networking, storage, and multi-tenancy isolation.
• Experience with GPU infrastructure and scheduling (NVAIE/DCGM, GPU operators, virtualization/MIG).
• Experience with infrastructure-as-code and GitOps tooling (Terraform/OpenTofu, Helm, ArgoCD, Crossplane).
• Proven track record operating production infrastructure under compliance, security, or regulatory constraints.

Responsibilities

• Own the cluster & cloud-native platform: compute, Kubernetes and scheduling, cluster fabric/networking, multi-tenancy, and distributed compute.
• Own the infrastructure foundation: Ubuntu/OS, BMC/bare-metal, DPU architecture, and NVAIE (GPU/Network/DCGM).
• Stand up and manage EY Agentic AI environments across cloud, on-prem AI Factory, edge, and air-gapped deployment modes.
• Deliver foundational platform capabilities such as Infrastructure Management, Kubernetes & Scheduling, and Cluster Fabric Management.
• Own cluster lifecycle, autoscaling, GPU pooling/virtualization, and multi-tenancy boundaries.
• Own secure execution and inference with Ray Serve, vLLM/NIM/Triton, and NVIDIA Dynamo, with sandboxed execution.
• Own cognitive and routing: Envoy AI Gateway, semantic routing, model/prompt selection, and streaming response handling.
• Collaborate with DevOps on CI/CD/CV, IaC/GitOps to ensure reproducible environments.
• Own backup, disaster recovery, and cross-environment replication with patching and platform hygiene.
• Ensure the substrate is modular and swappable to minimize vendor lock-in.

Skills

Kubernetes

Cloud platforms

Bare-metal

GPU scheduling

Multi-tenancy

Education

Bachelor’s or Master’s in CS

Tools

Terraform/OpenTofu

Helm

ArgoCD

Crossplane

Job description

EY is seeking AI Systems Engineers to build and operate the foundational substrate powering EY’s AI-native platform. You’ll own the infrastructure and cloud-native layers from bare-metal to Kubernetes, managing EY Fabric environments across cloud, on-prem, edge, and air-gapped targets.

This role suits a full-stack infrastructure leader focused on reliability, portability, and regulated client contexts, with an emphasis on scalable, secure, and production-ready platforms that enable downstream AI