AI Systems Engineer & Observability Leader

EY; Southfield (MI); Hybrid; USD 126,000 - 230,000; Full time

Job summary

EY seeks an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of our AI-native platform. You will drive CI/CD pipelines, governance, cost management, and deep observability across cloud, on‑prem, edge, and air‑gapped environments.

You’ll lead multi-tenant, secure AI workloads with policy-based releases, track telemetry and costs, and collaborate with platform, trust, and data teams to ensure repeatable, transparent services.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related field.
• 8+ years in DevOps, MLOps, platform, or observability engineering with AI ownership.
• Hands-on DevOps with CI/CD/CV pipelines and GitOps tooling.
• Hands-on expertise operating inference/model-serving frameworks on GPU infrastructure.
• Strong observability experience: Prometheus, Grafana, Loki, Tempo/Jaeger, OpenTelemetry.
• Experience with API gateways and request routing (Envoy or equivalent).
• Experience with FinOps tooling and quota/rate-limit enforcement.
• Familiarity with model/artifact registries and supply-chain scanning.
• Proven track record delivering AI/service infra under regulatory constraints.

Responsibilities

• Own DevOps and delivery for AI workloads: CI/CD/CV pipelines and rollout.
• Own governance and discovery for AI assets and registries.
• Own resource and cost management with quota and attribution.
• Own full observability stack: metrics, logs, traces, dashboards.
• Own OpenTelemetry collection and multi-tenant telemetry routing.
• Automate GitOps delivery and policy-driven verification.
• Close loop between delivery and observability for rollout decisions.
• Ensure per-tenant cost attribution and compliant operating models.

Skills

DevOps excellence

Model-serving expertise

Observability fundamentals

FinOps mindset

Governance & lineage

Multi‑env operations

Clear communication

Education

Bachelor’s or Master’s in CS or related field

Tools

ArgoCD

Helm

GitHub Actions

GitLab CI

Prometheus

Grafana

Loki

Tempo/Jaeger

OpenTelemetry

Ray Serve / vLLM / Triton / NIM

Job description

EY seeks an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of our AI-native platform. You will drive CI/CD pipelines, governance, cost management, and deep observability across cloud, on‑prem, edge, and air‑gapped environments.

You’ll lead multi-tenant, secure AI workloads with policy-based releases, track telemetry and costs, and collaborate with platform, trust, and data teams to ensure repeatable, transparent services.