AI Platform Engineer: DevOps, Observability & Governance

EY; Cincinnati (OH); Hybrid; USD 107,000 - 177,000; Full time

Benefits offered by this job

Hybrid work model

Total rewards package

Job summary

EY is seeking an AI Systems Engineer to own the delivery, model-serving, routing, and observability across EY's AI-native platform. The role sits at the intersection of DevOps, MLOps, FinOps and observability, requiring hands-on experience with GPU inference, automated pipelines, and cost-aware design across cloud, on‑prem, edge, and air‑gapped environments.

This role emphasizes end-to-end ownership of AI workloads, governance of assets, scalable observability, and policy‑driven delivery to

Qualifications

• 8+ years in DevOps, MLOps, platform, or observability engineering with production ownership of AI or high-throughput services.
• CI/CD/CV pipelines and GitOps tooling (ArgoCD, Helm, GitHub Actions/GitLab CI) for automated build, test, release, and rollback.
• Hands-on expertise operating inference/model-serving frameworks (Ray Serve, vLLM, Triton, or NIM) on GPU infrastructure.
• Strong observability experience with Prometheus, Grafana, Loki, Tempo/Jaeger and OpenTelemetry.
• Experience with API gateways and request routing (Envoy), including streaming responses.
• Familiarity with model/artifact registries and cost-tools (Harbor, MLflow, Trivy/SBOM).

Responsibilities

• Own CI/CD/CV pipelines that ship AI services, agents, and runtime components.
• Govern AI assets, registries, experiment tracking, and model metadata.
• Manage cost attribution and quotas to keep AI execution economical.
• Own the full observability stack: metrics, logs, traces, dashboards, and evaluation tools.
• Handle OpenTelemetry collection across multi-tenant environments.
• Automate GitOps-based delivery with quality and cost gates in pipelines.
• Bridge delivery and observability with telemetry to guide deployments and rollbacks.
• Ensure per-tenant identity stamping for FinOps and observability.

Skills

DevOps / MLOps

Observability

FinOps

GitOps

Inference serving

OpenTelemetry

GPU infra

Communication

Education

Bachelor's or Master’s in CS

Tools

Envoy

Prometheus

Grafana

Kubernetes

ArgoCD

MLflow

Trivy/SBOM

Job description

EY is seeking an AI Systems Engineer to own the delivery, model-serving, routing, and observability across EY's AI-native platform. The role sits at the intersection of DevOps, MLOps, FinOps and observability, requiring hands-on experience with GPU inference, automated pipelines, and cost-aware design across cloud, on‑prem, edge, and air‑gapped environments.

This role emphasizes end-to-end ownership of AI workloads, governance of assets, scalable observability, and policy‑driven delivery to