AI Systems Engineer & DevOps Observability Lead

EY; Des Moines (IA); On-site; USD 126,000 - 230,000; Full time

Benefits offered by this job

Hybrid work model

Medical and dental coverage

Pension and 401(k)

Paid time off

Job summary

EY is hiring an AI Systems Engineer to own delivery, model-serving, routing, and observability for its AI-native platform. The role spans CI/CD pipelines, governance, and cost controls across cloud, on‑prem, edge, and air‑gapped environments.

You will manage the full observability stack, model artifact registries, and secure deployments while operating in a hybrid, globally connected team. EY offers hybrid work, strong compensation, and broad benefits.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related technical field is required.
• 8+ years in DevOps, MLOps, platform, or observability engineering with hands-on production ownership of AI or high-throughput services.
• Hands-on DevOps experience including CI/CD/CV pipelines and GitOps tooling for automated build, test, release, and rollback.
• Hands-on expertise operating inference/model-serving frameworks on GPU infrastructure.
• Strong experience with observability stacks (Prometheus, Grafana, Loki, Tempo/Jaeger) and OpenTelemetry.
• Experience with API gateways and request routing (Envoy or equivalent).
• Experience with cost management / FinOps tooling and quota/rate-limit enforcement.
• Familiarity with model/artifact registries and supply-chain scanning.
• Proven track record operating AI or service infrastructure under compliance and regulatory constraints.

Responsibilities

• Own DevOps and delivery for AI workloads: CI/CD/CV pipelines that ship AI services and runtime components across environments.
• Own governance and discovery for AI assets and model metadata.
• Own resource and cost management with per-tenant attribution.
• Own the full observability stack: metrics, logs, traces, dashboards, and debugging tooling.
• Own OpenTelemetry collection layer for multi-tenant environments.
• Automate GitOps-based delivery and automatic quality/cost gates.
• Drive deployment decisions using telemetry and cost signals with automated rollback.
• Ensure cost and telemetry are identity-stamped and per-tenant.

Education

Bachelor’s or Master’s degree in Computer Science or related technical field

Tools

ArgoCD

Helm

GitHub Actions

GitLab CI

OpenTelemetry

Prometheus

Grafana

Loki

Tempo

Jaeger

Ray Serve

vLLM

Triton

NIM

Envoy

Job description

EY is hiring an AI Systems Engineer to own delivery, model-serving, routing, and observability for its AI-native platform. The role spans CI/CD pipelines, governance, and cost controls across cloud, on‑prem, edge, and air‑gapped environments.

You will manage the full observability stack, model artifact registries, and secure deployments while operating in a hybrid, globally connected team. EY offers hybrid work, strong compensation, and broad benefits.