AI Platform DevOps & Observability Lead

Ernst & Young Oman; Tallahassee (FL); Hybrid; USD 126,000 - 230,000; Full time

Benefits offered by this job

Hybrid work model

Total Rewards including medical and 4

Competitive compensation

Job summary

EY seeks an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of EY’s AI-native platform across cloud, on‑prem, edge, and air‑gapped environments.

You will own CI/CD/CV pipelines for AI workloads, governance of AI assets, cost attribution, and the full observability stack, enabling repeatable and economical AI workloads with strong telemetry and security controls.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related technical field.
• 8+ years in DevOps, MLOps, platform, or observability engineering with hands‑on production ownership of AI or high‑throughput services.
• Strong hands‑on DevOps experience, including CI/CD/CV pipelines and GitOps tooling.
• Hands‑on expertise operating inference/model‑serving frameworks on GPU infrastructure.
• Strong experience with observability stacks and OpenTelemetry.
• Experience with API gateways and request routing for streaming responses.
• Experience with cost management tools and quota/rate‑limit enforcement.
• Familiarity with model/artifact registries and governance.

Responsibilities

• Own DevOps and delivery for AI workloads: CI/CD/CV pipelines, automated build, test, verification, release, and rollback.
• Own governance and discovery for AI assets and registries (Harbor, MLflow, Trivy).
• Own resource and cost management with attribution and per‑tenant budgeting.
• Own the full observability stack: metrics, logs, traces, dashboards, and SLA/alerts.
• Automate GitOps‑based delivery and verification with policy gates.
• Close the loop between delivery and observability using telemetry and cost signals.

Skills

CI/CD pipelines

GitOps

Observability

Cost optimization

Model serving infra

Education

Bachelor’s or Master’s in Computer Science

Tools

Ray Serve

vLLM/Triton/NIM

Prometheus

Grafana

Loki

Envoy

MLflow

Harbor

Trivy

Job description

EY seeks an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of EY’s AI-native platform across cloud, on‑prem, edge, and air‑gapped environments.

You will own CI/CD/CV pipelines for AI workloads, governance of AI assets, cost attribution, and the full observability stack, enabling repeatable and economical AI workloads with strong telemetry and security controls.