AI Platform Delivery & Observability Lead

Ernst & Young Oman; Miami (FL); Hybrid; USD 126,000 - 230,000; Full time

Job summary

EY seeks an AI Systems Engineer to own delivery, model-serving, routing, and observability for EY’s AI-native platform. You will manage CI/CD pipelines, governance of AI assets, and cost attribution across cloud, on-prem, edge, and air-gapped environments.

You’ll lead DevOps and observability, with experience in GPU inference, multi-environment runtimes, and secure model execution. The role blends DevOps, MLOps, FinOps, and governance responsibilities.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related field.
• 3+ years of DevOps experience in AI/ML platforms.
• Hands-on with CI/CD pipelines and GitOps tooling for automated delivery.
• Experience operating AI/model-serving frameworks on GPU infrastructure.
• Proficient in observability stacks and telemetry collection.

Responsibilities

• Own DevOps and delivery for AI workloads and pipelines.
• Own governance and discovery for AI assets and registries.
• Own resource and cost management with per-tenant attribution.
• Own the full observability stack and SLA/alerts.

Skills

CI/CD pipelines

GitOps

OpenTelemetry

GPU inference

Observability

Cost attribution

Regulatory compliance

Envoy/traffic routing

Platform ownership

Education

Bachelor’s or Master’s degree in Computer Science or related field

Tools

ArgoCD

Helm

GitHub Actions/GitLab CI

Ray Serve

vLLM/Triton/NIM

Prometheus/Grafana

LangSmith/Langfuse

OpenLineage/OpenTelemetry

Job description

EY seeks an AI Systems Engineer to own delivery, model-serving, routing, and observability for EY’s AI-native platform. You will manage CI/CD pipelines, governance of AI assets, and cost attribution across cloud, on-prem, edge, and air-gapped environments.

You’ll lead DevOps and observability, with experience in GPU inference, multi-environment runtimes, and secure model execution. The role blends DevOps, MLOps, FinOps, and governance responsibilities.