AI Platform Delivery & Observability Lead

EY; Grand Rapids (MI); On-site; USD 126,000 - 230,000; Full time

Job summary

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability for EY’s AI-native platform. You will manage CI/CD pipelines, secure model execution, and governance across cloud, on‑prem, edge, and air‑gapped environments, ensuring repeatable delivery and cost control.

The role sits at the intersection of DevOps, MLOps, FinOps, and observability, requiring strong skills in telemetry, security, and multi-tenant cost attribution.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related technical field.
• 8+ years in DevOps, MLOps, platform, or observability engineering with hands‑on ownership of AI or high‑throughput services.
• Hands‑on CI/CD/CV pipelines and GitOps tooling for automated build, test, release, and rollback.
• Hands‑on expertise operating inference/model‑serving frameworks on GPU infrastructure.
• Strong experience with observability stacks (Prometheus, Grafana, Loki, Tempo/Jaeger) and OpenTelemetry.
• Experience with API gateways and request routing (Envoy) including streaming responses.
• Experience with cost management / FinOps tooling and quota/rate‑limit enforcement.
• Familiarity with model/artifact registries and supply‑chain scanning.

Responsibilities

• Own DevOps and delivery for AI workloads: CI/CD/CV pipelines and release management.
• Own governance and discovery for AI assets and registries (Artifactory/Nexus, MLflow, Harbor).
• Own resource and cost management with quotas and attribution.
• Own the full observability stack: metrics, logs, traces, dashboards.
• Own the OpenTelemetry collection layer for multi‑tenant environments.
• Automate GitOps‑based delivery and verification with policy gates.
• Drive deployment decisions using telemetry and cost signals for safe rollouts.
• Ensure per‑tenant cost telemetry and governance across environments.

Skills

DevOps

MLOps

Observability

GitOps

OpenTelemetry

Education

Bachelor’s or Master’s degree in CS or related field

Tools

Ray Serve

vLLM

Triton

NIM

Job description

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability for EY’s AI-native platform. You will manage CI/CD pipelines, secure model execution, and governance across cloud, on‑prem, edge, and air‑gapped environments, ensuring repeatable delivery and cost control.

The role sits at the intersection of DevOps, MLOps, FinOps, and observability, requiring strong skills in telemetry, security, and multi-tenant cost attribution.