AI Platform Infra Engineer - Kubernetes & Hybrid Cloud

Ernst & Young Oman; Springfield (IL); Hybrid; USD 126,000 - 230,000; Full time

Benefits offered by this job

Hybrid work model

Medical and dental coverage

401(k) / pension

Paid time off

Job summary

EY seeks AI Systems Engineers to build and operate the foundational substrate for EY’s AI-native platform. You will own the cloud-native platform, Kubernetes orchestration, and multi-tenant scaling across cloud, on‑prem, edge, and air‑gapped targets.

This role suits a full‑stack infrastructure leader comfortable with bare‑metal and GPU systems, production Kubernetes at scale, and portability for regulated clients.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related field.
• 8+ years building or operating enterprise infrastructure or large-scale Kubernetes environments.
• Hands-on with Kubernetes distributions and full cluster lifecycle management.
• Deep experience with bare-metal, cloud, hybrid, on-prem, and air-gapped deployment models.
• Strong grounding in cluster networking, storage, and multi-tenancy isolation.
• Experience with GPU infrastructure and scheduling (NVAIE/DCGM).
• Experience with IaC and GitOps tooling (Terraform/OpenTofu, Helm, ArgoCD, Crossplane).
• Proven track record operating production infrastructure under regulatory constraints.

Responsibilities

• Own the cluster & cloud-native platform: compute, Kubernetes, scheduling, multi-tenancy, and distributed compute.
• Own the infrastructure foundation: Ubuntu/OS, bare-metal, DPU, NVAIE, ensuring production readiness.
• Stand up EY Agentic AI environments across cloud, on‑prem, edge, and air-gapped targets.
• Deliver foundational platform capabilities to support downstream runtime, data, and execution services.
• Own cluster lifecycle, autoscaling, GPU pooling, and tenancy boundaries.
• Own secure execution and inference with Ray Serve, vLLM/NIM/Triton, and NVIDIA technologies.
• Own cognitive and routing: Envoy AI Gateway, routing, model/prompt selection, streaming responses.
• Collaborate on CI/CD/CV and IaC/GitOps to ensure reproducible environments.

Skills

Kubernetes

Multi-tenancy at scale

Bare-metal & GPU

Infrastructure‑as‑Code

GitOps

AI gateways

Regulatory compliance

Security

Education

Bachelor’s or Master’s in Computer Science

Tools

RKE2

EKS/AKS/GKE

K3s

Terraform/OpenTofu

Helm

ArgoCD

Crossplane

Job description

EY seeks AI Systems Engineers to build and operate the foundational substrate for EY’s AI-native platform. You will own the cloud-native platform, Kubernetes orchestration, and multi-tenant scaling across cloud, on‑prem, edge, and air‑gapped targets.

This role suits a full‑stack infrastructure leader comfortable with bare‑metal and GPU systems, production Kubernetes at scale, and portability for regulated clients.