AI Platform Engineer - DevOps & Observability Lead

EY; Oklahoma City (OK); Hybrid; USD 126,000 - 230,000; Full time

Benefits offered by this job

Hybrid work model

Total Rewards package

Flexible vacation policy

Professional development support

Job summary

EY in the United States is seeking an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of EY’s AI-native platform. You will build CI/CD pipelines, secure model execution, and ensure scalable, repeatable AI workloads across cloud, on‑prem, and edge environments.

You’ll govern AI assets, manage cost attribution, and implement full observability stacks using Prometheus, Grafana, Loki, Tempo/Jaeger, OpenTelemetry, and related tools while coordinating with

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related technical field.
• 8+ years in DevOps, MLOps, platform, or observability engineering with hands-on production ownership of AI or high-throughput services.
• Hands-on CI/CD/CV pipelines and GitOps tooling (ArgoCD, Helm, GitHub Actions/GitLab CI).
• Hands-on expertise operating inference/model-serving frameworks on GPU infrastructure.
• Strong observability stacks (Prometheus, Grafana, Loki, Tempo/Jaeger) and OpenTelemetry.
• Experience with API gateways and request routing (Envoy), including streaming responses.
• Experience with cost management / FinOps tooling and quota/rate-limit enforcement.
• Familiarity with model/artifact registries and registry tooling (Harbor, MLflow, Trivy).
• Proven track record operating AI or service infrastructure under regulatory constraints.

Responsibilities

• Own DevOps and delivery for AI workloads: CI/CD/CV pipelines, release, and rollback for AI services and runtime components.
• Own governance and discovery for AI assets including registries, experiment tracking, and license management.
• Own resource and cost management with quota and rate limits to keep AI execution bounded per tenant.
• Own the full observability stack: metrics, logs, traces, dashboards, and AI debugging tools.
• Own the OpenTelemetry collection layer, including multi-tenant receivers and exporters.
• Automate GitOps-based delivery and continuous verification with policy gates.
• Close the loop between delivery and observability using telemetry and cost signals for deployment decisions.
• Ensure identity-stamped cost and telemetry per tenant; align FinOps with workloads.

Skills

DevOps & MLOps

Observability

GPU Inference

OpenTelemetry

Cost optimization

CI/CD pipelines

GitOps tooling

Model governance

Education

Bachelor’s or Master’s degree in Computer Science or related field

Tools

Ray Serve

vLLM/Triton/NIM

Prometheus/Grafana

Loki/Tempo/Jaeger

Envoy

Harbor

MLflow

Trivy

OpenCost/Kubecost

OpenLineage

Job description

EY in the United States is seeking an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of EY’s AI-native platform. You will build CI/CD pipelines, secure model execution, and ensure scalable, repeatable AI workloads across cloud, on‑prem, and edge environments.

You’ll govern AI assets, manage cost attribution, and implement full observability stacks using Prometheus, Grafana, Loki, Tempo/Jaeger, OpenTelemetry, and related tools while coordinating with