Senior AI Platform Infrastructure Engineer

Ernst & Young Oman; Houston (TX); Hybrid; USD 126,000 - 262,000; Full time

Benefits offered by this job

Medical and dental coverage

401(k) retirement plan

Flexible vacation policy

Hybrid work model

Job summary

EY seeks AI Systems Engineers to build and operate the foundational substrate for its AI-native platform, spanning bare-metal to Kubernetes at scale. You will manage cloud-native platforms across cloud, on‑prem, edge and air-gapped targets, focusing on portability, reliability, and compliance.

You will own infrastructure lifecycle, multi-tenancy, and secure inference workloads, collaborating with security, product, and delivery teams to enable downstream AI workloads with velocity and safety.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related technical field.
• 8+ years building or operating enterprise infrastructure, cloud platforms, or large-scale Kubernetes environments.
• Hands-on with Kubernetes distributions (RKE2, EKS/AKS/GKE, K3s) and full cluster lifecycle management.
• Experience across cloud, on-prem, edge, and air-gapped deployments.
• Strong grounding in cluster networking, storage, and multi-tenancy isolation.
• Experience with GPU infrastructure and scheduling.
• Experience with infrastructure-as-code and GitOps tooling.
• Proven track record in regulated environments and collaborating with security/product teams.

Responsibilities

• Own the cluster & cloud-native platform, including compute, Kubernetes, and multi-tenancy.
• Own infrastructure foundation (Ubuntu, bare-metal, DPU, NVAIE) and production-readiness.
• Stand up EY Agentic AI environments across cloud, on-prem, edge, and air-gapped targets.
• Deliver foundational platform capabilities to support downstream runtime and data services.
• Own cluster lifecycle, autoscaling, GPU pooling, and multi- tenancy boundaries.
• Own secure execution and inference with sandboxing and model tooling.
• Own cognitive routing and semantic routing for model selection and throughput.
• Collaborate on CI/CD, GitOps, and IaC to ensure reproducibility and drift-free environments.
• Manage backup, disaster recovery, and cross-environment replication.

Skills

Kubernetes at scale

Bare-metal & GPU infra

Cloud-native platforms

GitOps & IaC

Cluster networking (Cilium)

Security/compliance awareness

CI/CD tooling (ArgoCD)

Education

Bachelor’s or Master’s degree in Computer Science or related field

Tools

RKE2

EKS/AKS/GKE

K3s

Terraform/OpenTofu

Helm

ArgoCD

Crossplane

NVIDIA DCGM

Job description

EY seeks AI Systems Engineers to build and operate the foundational substrate for its AI-native platform, spanning bare-metal to Kubernetes at scale. You will manage cloud-native platforms across cloud, on‑prem, edge and air-gapped targets, focusing on portability, reliability, and compliance.

You will own infrastructure lifecycle, multi-tenancy, and secure inference workloads, collaborating with security, product, and delivery teams to enable downstream AI workloads with velocity and safety.