Senior AI Platform Infrastructure Engineer

Ernst & Young Oman; Akron (OH); Hybrid; USD 126,000 - 230,000; Full time

Benefits offered by this job

Hybrid work model

Comprehensive compensation & benefits

Job summary

EY seeks an AI Systems Engineer to build and operate the foundational substrate powering EY’s AI-native platform. You’ll own cloud-native platform layers from bare-metal to Kubernetes, across cloud, on‑prem, edge, and air‑gapped targets.

This senior role emphasizes reliability, portability, and isolation, with secure model execution and multi-tenant support, collaborating with DevOps, security, and product teams.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related field.
• 8+ years building or operating enterprise infrastructure, cloud platforms, or large-scale Kubernetes environments.
• Hands-on with Kubernetes distributions (RKE2, EKS/AKS/GKE, K3s) and full cluster lifecycle management.
• Deep experience with bare-metal, cloud, hybrid, on-prem, and air-gapped deployment models.
• Strong grounding in cluster networking (Cilium/service mesh/CNI), storage, and multi-tenancy isolation.
• Experience with GPU infrastructure and scheduling (NVAIE/DCGM, GPU operators, virtualization).
• Experience with infrastructure-as-code and GitOps tooling (Terraform/OpenTofu, Helm, ArgoCD, Crossplane).
• Proven track record operating production infrastructure under compliance, security, or regulatory constraints.
• Ability to work with security, architecture, product, and delivery teams.

Responsibilities

• Own the cluster & cloud-native platform across multiple environments (cloud, on-prem, edge, air-gapped).
• Own the infrastructure foundation (Ubuntu/OS, bare-metal, DPU, NVAIE) provisioning and patching.
• Manage EY Agentic AI environments across EKS/AKS/GKE, RKE2/NVAIE, edge (K3s).
• Deliver foundational platform capabilities (Infrastructure Management, Kubernetes & Scheduling, Cluster Fabric).
• Own cluster lifecycle, autoscaling, GPU pooling, and multi-tenancy boundaries.
• Own secure execution and inference with Ray Serve, vLLM/NIM/Triton, and GPU sandboxing.
• Own cognitive routing (Envoy AI Gateway, model/prompt selection, streaming).
• Collaborate on CI/CD/CV (ArgoCD), IaC/GitOps (Helm/OpenTofu), ensuring reproducibility.
• Maintain backup, DR, cross-env replication (Velero, Cilium Mesh).
• Ensure modular, swappable substrate to minimize vendor lock-in.

Skills

Cloud-native infra

Kubernetes at scale

Bare-metal & GPU

Cluster lifecycle

Infrastructure-as-code

GitOps

Security & compliance

Cross-team collaboration

Networking & multi-tenancy

Delivery automation

Education

Bachelor’s or Master’s degree in Computer Science or related field

Tools

Kubernetes (RKE2, EKS/AKS/GKE, K3s)

Terraform/OpenTofu

Helm

ArgoCD

Crossplane

Job description

EY seeks an AI Systems Engineer to build and operate the foundational substrate powering EY’s AI-native platform. You’ll own cloud-native platform layers from bare-metal to Kubernetes, across cloud, on‑prem, edge, and air‑gapped targets.

This senior role emphasizes reliability, portability, and isolation, with secure model execution and multi-tenant support, collaborating with DevOps, security, and product teams.