Senior AI Platform Infrastructure Engineer

Ernst & Young Oman; Miami (FL); Hybrid; USD 126,000 - 230,000; Full time

Benefits offered by this job

Hybrid work model

Total Rewards package

Pension and 401(k) plans

Job summary

EY is seeking an AI Systems Engineer to build and operate EY’s foundational AI-native platform across cloud, on‑prem, edge and air‑gapped environments. You will own the Kubernetes-based substrate, multi‑tenancy, and hardware abstraction, delivering reliable, portable infrastructure for Agentic AI workloads.

You will collaborate with DevOps and security teams to enable scalable, compliant deployments at scale, with a focus on reliability, portability, and velocity for downstream teams.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related technical field.
• 8+ years building or operating enterprise infrastructure, cloud platforms, or large-scale Kubernetes environments.
• Hands-on expertise with Kubernetes distributions (RKE2, EKS/AKS/GKE, K3s) and full cluster lifecycle management.
• Deep experience with bare-metal, cloud, hybrid, on-prem, and ideally air-gapped deployment models.
• Strong grounding in cluster networking (Cilium/service mesh/CNI), storage, and multi-tenancy isolation.
• Experience with GPU infrastructure and scheduling (NVAIE/DCGM, GPU operators, virtualization).
• Experience with infrastructure-as-code and GitOps tooling (Terraform/OpenTofu, Helm, ArgoCD, Crossplane).
• Proven track record operating production infrastructure under compliance, security, or regulatory constraints.

Responsibilities

• Own the cluster & cloud-native platform: compute, Kubernetes and scheduling, cluster fabric/networking, multi-tenancy, and distributed compute.
• Own the infrastructure foundation: Ubuntu/OS, BMC/bare-metal, DPU architecture, and NVAIE (GPU/Network/DCGM).
• Stand up and manage EY Agentic AI environments across cloud, on-prem, edge, and air-gapped deployment modes.
• Deliver foundational platform capabilities such as Infrastructure Management, Kubernetes & Scheduling, and Cluster Fabric Management.
• Own cluster lifecycle, autoscaling, GPU pooling/virtualization, and multi-tenancy boundaries.
• Own secure execution and inference: Ray Serve, vLLM/NIM/Triton, and NVIDIA Dynamo, with sandboxed execution.
• Own cognitive and routing: Envoy AI Gateway, semantic routing, model/prompt selection, and streaming response handling.
• Collaborate with DevOps on CI/CD/CV, IaC/GitOps to keep environments reproducible and drift-free.
• Own backup, disaster recovery, and cross-environment replication for high availability.
• Ensure the substrate is modular and swappable to minimize vendor lock-in.

Skills

Kubernetes

Cloud-native

Multi-tenancy

Infrastructure-as-code

GitOps

Security/compliance

Education

Bachelor’s or Master’s degree

Tools

RKE2

EKS/AKS/GKE

K3s

Terraform/OpenTofu

Helm

ArgoCD

Crossplane

Job description

EY is seeking an AI Systems Engineer to build and operate EY’s foundational AI-native platform across cloud, on‑prem, edge and air‑gapped environments. You will own the Kubernetes-based substrate, multi‑tenancy, and hardware abstraction, delivering reliable, portable infrastructure for Agentic AI workloads.

You will collaborate with DevOps and security teams to enable scalable, compliant deployments at scale, with a focus on reliability, portability, and velocity for downstream teams.