AI Platform Delivery & Observability Lead

EY; Salt Lake City (UT); Hybrid; USD 126,000 - 230,000; Full time

Benefits offered by this job

Total Rewards package

Hybrid work model

Pension/401(k) and paid time off

Job summary

EY seeks an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of EY’s AI-native platform. You will manage CI/CD/CV pipelines, governance, and cost controls across cloud, on-prem, edge, and air-gapped environments.

You will own the full observability stack, telemetry collection, and multi-tenant cost attribution while collaborating with trust, data, and platform teams to deliver secure, auditable AI workloads.

Qualifications

• Bachelor's or Master’s degree in Computer Science or related field.
• 8+ years in DevOps, MLOps, platform, or observability engineering with hands-on ownership of AI or high-throughput services.
• Hands-on DevOps experience with CI/CD/CV pipelines and GitOps tooling for automated build, test, release, and rollback.
• Hands-on expertise operating inference/model-serving frameworks on GPU infrastructure.
• Strong observability experience: metrics, logs, traces and OpenTelemetry.
• Experience with API gateways and request routing including streaming responses.
• Familiarity with cost management tools and quota/rate-limit enforcement.
• Knowledge of model/artifact registries and supply-chain scanning.

Responsibilities

• Own DevOps and delivery for AI workloads and CI/CD/CV pipelines across environments.
• Own governance and discovery for AI assets and registries.
• Own resource and cost management with per-tenant attribution.
• Own the full observability stack: metrics, logs, traces, dashboards, and debugging tools.
• Own OpenTelemetry collection and multi-tenant data pipelines for signals.
• Automate GitOps-based delivery and verification with policy gates.
• Bridge delivery and observability using telemetry and cost signals to guide deployments.
• Ensure cost and telemetry are per-tenant and SLA-driven.

Skills

DevOps

MLOps

Observability

FinOps

GitOps

LangSmith

Education

Bachelor's or Master's in Computer Science

Tools

ArgoCD

Helm

GitHub Actions

GitLab CI

Ray Serve

vLLM

Triton

NIM

Prometheus

Grafana

Loki

Tempo/Jaeger

OpenTelemetry

Harbor

MLflow

Trivy

Job description

EY seeks an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of EY’s AI-native platform. You will manage CI/CD/CV pipelines, governance, and cost controls across cloud, on-prem, edge, and air-gapped environments.

You will own the full observability stack, telemetry collection, and multi-tenant cost attribution while collaborating with trust, data, and platform teams to deliver secure, auditable AI workloads.