AI Platform Infra Architect (Remote)

EY; Tallahassee (FL); On-site; USD 125,000 - 230,000; Full time

Job summary

EY is seeking an AI Systems Engineer to design and operate EY's foundational cloud-native platform powering our AI-native services. You will own the Kubernetes, multi-tenant infrastructure, and cross-environment deployment across cloud, on-prem, edge, and air-gapped targets.

This role requires deep hands-on experience with bare-metal and GPU infrastructure, GitOps, and secure, scalable runtime environments.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related technical field.
• 8+ years building or operating enterprise infrastructure and large-scale Kubernetes.
• Hands-on experience with Kubernetes distributions and cluster lifecycle management.
• Deep experience with bare-metal, cloud, hybrid, on-prem, and air-gapped deployments.
• Strong grounding in cluster Networking, storage, and multi-tenancy isolation.
• Experience with GPU infrastructure and scheduling (NVAIE/DCGM).

Responsibilities

• Own the cluster and cloud-native platform for Agentic AI workloads.
• Manage Ubuntu/OS, BMC, bare-metal and GPU infrastructure.
• Stand up EY Agentic AI environments across cloud, on‑prem, edge, and air-gapped modes.
• Deliver platform capabilities such as Infrastructure Management and Kubernetes scheduling.
• Own cluster lifecycle, autoscaling, and multi-tenancy boundaries.
• Ensure secure execution/inference with Ray Serve, vLLM/Triton, and NVIDIA components.
• Oversee Envoy AI Gateway and model/prompt routing.
• Collaborate with DevOps on CI/CD and GitOps for reproducible environments.
• Oversee backup, DR and cross-environment replication.

Skills

Cloud-native platform engineering

Bare-metal & GPU infra

Multi-tenancy at scale

Kubernetes & scheduling

Security & compliance awareness

Effective communicator

Education

Bachelor's or Master's in CS or related field

Tools

RKE2

EKS/AKS/GKE

K3s

Terraform/OpenTofu

Helm

ArgoCD

Crossplane

Job description

EY is seeking an AI Systems Engineer to design and operate EY's foundational cloud-native platform powering our AI-native services. You will own the Kubernetes, multi-tenant infrastructure, and cross-environment deployment across cloud, on-prem, edge, and air-gapped targets.

This role requires deep hands-on experience with bare-metal and GPU infrastructure, GitOps, and secure, scalable runtime environments.