AI Systems Engineer: DevOps, Delivery & Observability

EY; Des Moines (IA); Hybrid; USD 107,000 - 177,000; Full time

Job summary

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability for EY’s AI-native platform across cloud, on‑prem, edge, and air‑gapped environments. You’ll shape how AI services are built, deployed, monitored, and governed, working at the intersection of DevOps, MLOps, FinOps, and observability.

The role demands 8+ years of hands-on experience and strong model-serving expertise.

Qualifications

• 8+ years in DevOps, MLOps, platform, or observability engineering with hands-on ownership of AI or high-throughput services.
• Hands-on experience with CI/CD/CV pipelines and GitOps tooling for automated build, test, release, and rollback.
• Experience operating inference/model-serving frameworks on GPU infrastructure.
• Strong observability skills across metrics, logs, traces, and OpenTelemetry.
• Familiarity with model/artifact registries, registry scanning, and supply-chain tooling.
• Ability to define ownership boundaries and consumption contracts with multiple teams.

Responsibilities

• Own delivery and runtime surface for AI workloads, including CI/CD/CV pipelines and secure model execution.
• Manage governance, discovery, cost attribution, and telemetry for AI assets.
• Oversee observability stack with metrics, logs, traces, dashboards, and evaluation tooling.
• Automate GitOps-based delivery with policy gates and automated rollbacks.
• Drive multi-tenant cost control and end-to-end traceability of AI workloads.

Skills

DevOps

MLOps

Platform engineering

Observability

OpenTelemetry

Cost/FinOps

GitOps tooling

Ray Serve / vLLM / Triton / NIM

Prometheus / Grafana / Loki

Education

Bachelor’s or Master’s degree in Computer Science or related field

Tools

ArgoCD

Helm

GitHub Actions

GitLab CI

Harbor

MLflow

Trivy/SBOM

Envoy

LangSmith / Langfuse

DCGM

Kubecost/OpenCost

Job description

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability for EY’s AI-native platform across cloud, on‑prem, edge, and air‑gapped environments. You’ll shape how AI services are built, deployed, monitored, and governed, working at the intersection of DevOps, MLOps, FinOps, and observability.

The role demands 8+ years of hands-on experience and strong model-serving expertise.