AI Systems Engineer: AI Delivery & Observability

EY; Cleveland (OH); Hybrid; USD 126,000 - 230,000; Full time

Benefits offered by this job

Hybrid work model

Medical and dental coverage

Pension and 401(k) plans

Paid time off

Job summary

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability across EY’s AI-native platform. You will manage CI/CD/CV pipelines, governance of AI assets, and a comprehensive observability stack to ensure secure, economical, and transparent AI workloads across cloud, on‑prem, edge, and air‑gapped environments.

This role sits at the intersection of DevOps, MLOps, FinOps, and observability, requiring strong collaboration with platform, trust, and data teams to

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related field.
• 8+ years in DevOps, MLOps, platform, or observability engineering with ownership of AI or high‑throughput services.
• Hands‑on DevOps experience including CI/CD/CV pipelines and GitOps tooling (ArgoCD, Helm, GitHub Actions/GitLab CI).
• Hands‑on expertise operating inference/model‑serving frameworks (Ray Serve, vLLM, Triton, or NIM) on GPU infrastructure.
• Strong observability stacks (Prometheus, Grafana, Loki, Tempo/Jaeger) and OpenTelemetry.
• Experience with API gateways and request routing (Envoy) including streaming responses.
• Familiarity with model/artifact registries and cost tooling (Harbor, MLflow, Trivy, OpenCost, Kubecost).
• Proven track record operating AI/service infrastructure under compliance and regulatory constraints.

Responsibilities

• Own DevOps and delivery for AI workloads: CI/CD/CV pipelines, automated build/test/verification, release and rollback.
• Own governance and discovery for AI assets: registries, model metadata, artifact lineage and license management.
• Own resource and cost management: quotas, rate limits, cost attribution and per‑tenant boundaries.
• Own the full observability stack: metrics, logs, traces, dashboards, and LLM evaluation tooling.
• Own OpenTelemetry collection: multi‑tenant receivers, exporters, queues, GPU telemetry, and data routing.
• Automate GitOps delivery and policy gates within pipelines to ensure compliant releases.
• Close the loop between delivery and observability using telemetry and cost signals for deployment decisions.
• Ensure identity‑stamped cost/telemetry per tenant across all AI workloads.

Education

Bachelor’s or Master’s degree in Computer Science or related technical field

Tools

ArgoCD

Helm

GitHub Actions

GitLab CI

MLflow

Trivy

OpenLineage

Kubecost

Prometheus

Grafana

Loki

Tempo

Jaeger

Envoy

Job description

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability across EY’s AI-native platform. You will manage CI/CD/CV pipelines, governance of AI assets, and a comprehensive observability stack to ensure secure, economical, and transparent AI workloads across cloud, on‑prem, edge, and air‑gapped environments.

This role sits at the intersection of DevOps, MLOps, FinOps, and observability, requiring strong collaboration with platform, trust, and data teams to