Hybrid AI Platform Engineer - Kubernetes and Infra Lead

EY; City of Albany (NY); On-site; USD 126,000 - 230,000; Full time

Benefits offered by this job

Hybrid work model

Total Rewards package

Medical and dental coverage

Pension and 401(k)

Job summary

EY is seeking an AI Systems Engineer to build and operate the foundational substrate powering EY’s AI-native platform. You’ll own the cloud-native platform layers, from bare-metal and GPU infrastructure to Kubernetes, across cloud, on-prem, edge, and air-gapped targets.

This role requires deep infra expertise, portability-first design, and collaboration with security, architecture, and delivery teams to drive reliability and scalability in regulated client contexts.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related technical field.
• 8+ years building or operating enterprise infrastructure, cloud platforms, or large-scale Kubernetes environments.
• Hands-on experience with Kubernetes distributions (RKE2, EKS/AKS/GKE, K3s) and full cluster lifecycle management.
• Deep experience with bare-metal, cloud, hybrid, on-prem, and ideally air-gapped deployment models.
• Strong grounding in cluster networking (Cilium/service mesh/CNI), storage, and multi-tenancy isolation.
• Experience with GPU infrastructure and scheduling (NVAIE/DCGM, GPU operators, virtualization/MIG).
• Experience with infrastructure-as-code and GitOps tooling (Terraform/OpenTofu, Helm, ArgoCD, Crossplane).
• Proven track record operating production infrastructure under compliance, security, or regulatory constraints.

Responsibilities

• Own the cluster & cloud-native platform: compute, Kubernetes and scheduling, cluster fabric/networking, multi-tenancy, and distributed compute.
• Own the infrastructure foundation: Ubuntu/OS, BMC/bare-metal, DPU architecture, and NVAIE (GPU/Network/DCGM).
• Stand up and manage EY Agentic AI environments across cloud, on-prem AI Factory, edge, and air-gapped modes with a single stack contract.
• Deliver foundational platform capabilities such as Infrastructure Management, Kubernetes & Scheduling, and Cluster Fabric Management.
• Own cluster lifecycle, autoscaling, GPU pooling/virtualization, and multi-tenancy boundaries for isolated capacity per tenant.
• Own secure execution and inference: Ray Serve, vLLM/NIM/Triton, with sandboxed execution for safety.
• Own cognitive and routing: Envoy AI Gateway, semantic routing, and model/prompt selection under constraints.
• Collaborate with DevOps on CI/CD/CV, IaC/GitOps to ensure reproducible environments.
• Own backup, disaster recovery, and cross-environment replication with patching and hygiene.
• Ensure the substrate is modular and swappable to minimize vendor lock-in.

Skills

Kubernetes

Cloud-native infra

Multi-tenancy

Bare-metal

GPU infrastructure

GitOps

Security/compliance

Cross-functional communication

Education

Bachelor’s or Master’s in CS or related field

Tools

RKE2

EKS/AKS/GKE

K3s

Terraform

Helm

ArgoCD

Crossplane

OpenTofu

Job description

EY is seeking an AI Systems Engineer to build and operate the foundational substrate powering EY’s AI-native platform. You’ll own the cloud-native platform layers, from bare-metal and GPU infrastructure to Kubernetes, across cloud, on-prem, edge, and air-gapped targets.

This role requires deep infra expertise, portability-first design, and collaboration with security, architecture, and delivery teams to drive reliability and scalability in regulated client contexts.