AI Platform Engineer: Delivery, Observability & FinOps

EY; Chicago (IL); Hybrid; USD 126,000 - 230,000; Full time

Job summary

EY seeks an AI Systems Engineer to own delivery, model-serving, routing, and observability across EY’s AI-native platform. You’ll ship, run, and observe AI workloads with governance, cost, and telemetry baked in from day one.

You'll bridge DevOps, MLOps, FinOps, and observability, building automated pipelines, secure model execution, and multi‑environment runtimes across cloud and on‑prem. This role demands production ownership and strong collaboration across teams.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or a related technical field.
• 8+ years in DevOps, MLOps, platform, or observability engineering with production ownership of AI or high-throughput services.
• Hands-on experience with CI/CD/CV pipelines and GitOps tooling for automated build, test, release, and rollback.
• Hands-on expertise operating inference/model-serving frameworks on GPU infrastructure.
• Strong observability stacks and cost-visibility tooling experience.

Responsibilities

• Own DevOps and delivery for AI workloads: build and operate CI/CD/CV pipelines that ship AI services and runtime components.
• Own governance and discovery for AI assets, including registries, model metadata, and license management.
• Own resource and cost management with quotas and rate limits to keep AI execution economical.
• Own the full observability stack: metrics, logs, traces, dashboards, and SLA alerts.
• Own OpenTelemetry collection layer and multi-tenant telemetry routing.
• Automate GitOps delivery and embed quality and cost gates in pipelines.
• Close the loop between delivery and observability to guide deployment decisions and rollback.

Skills

DevOps expertise

MLOps experience

OpenTelemetry

GitOps tooling

GPU inference

Cost governance

Regulatory/compliance

Communication skills

Education

Bachelor’s or Master’s in CS

Tools

Ray Serve

vLLM

Triton

NIM

Prometheus

Grafana

Loki

Job description

EY seeks an AI Systems Engineer to own delivery, model-serving, routing, and observability across EY’s AI-native platform. You’ll ship, run, and observe AI workloads with governance, cost, and telemetry baked in from day one.

You'll bridge DevOps, MLOps, FinOps, and observability, building automated pipelines, secure model execution, and multi‑environment runtimes across cloud and on‑prem. This role demands production ownership and strong collaboration across teams.