AI Platform DevOps & Observability Lead

EY; New York (NY); On-site; USD 126,000 - 230,000; Full time

Benefits offered by this job

Medical and dental coverage

Pension and 401(k) plans

Paid time off

Job summary

EY is seeking an AI Systems Engineer to own the delivery, routing, and observability layer of EY’s AI-native platform. You will manage CI/CD pipelines, governance for AI assets, and cost attribution across cloud, on-prem, edge, and air‑gapped environments.

You’ll work across OpenTelemetry, Grafana, Prometheus, and model-serving stacks on GPUs, driving repeatable, auditable AI workloads with strong FinOps discipline. This role embraces hybrid/remote work in the US.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or a related technical field.
• 8+ years in DevOps, MLOps, platform, or observability engineering with hands-on ownership of AI or high-throughput services.
• Hands-on DevOps experience with CI/CD/CV pipelines and GitOps tooling for automated build, test, release, and rollback.
• Hands-on expertise operating inference/model-serving frameworks on GPU infrastructure.
• Strong observability skills across metrics, logs, traces, and OpenTelemetry.
• Experience with API gateways and request routing, including streaming responses.
• Familiarity with cost management tooling and quota/rate-limit enforcement.
• Knowledge of model/artifact registries and supply-chain scanning.

Responsibilities

• Own DevOps and delivery for AI workloads: CI/CD/CV pipelines that ship AI services and runtime components.
• Own governance and discovery for AI assets, including registries and experiment tracking.
• Own resource and cost management with quotas and attribution per tenant.
• Own full observability stack: metrics, logs, traces, dashboards, and LLM tooling.
• Own OpenTelemetry collection and multi-tenant routing for signals and telemetry.
• Automate GitOps-based delivery with quality, integrity, and cost gates in pipelines.
• Close loop between delivery and observability to drive deployment decisions and automated rollbacks.
• Ensure cost/telemetry are per-tenant and attributable end-to-end.

Skills

DevOps

GitOps

MLOps

Observability

Cost management

OpenTelemetry

GPU inference

Model governance

Multi-environment

Regulatory compliance

Education

Bachelor’s or Master’s degree in Computer Science or related technical field

Tools

Ray Serve

vLLM

Triton

NIM

Prometheus

Grafana

Loki

Tempo/Jaeger

Envoy

ArgoCD

Helm

GitHub Actions

GitLab CI

Harbor

MLflow

Trivy

OpenLineage

Kubecost

OpenCost

Job description

EY is seeking an AI Systems Engineer to own the delivery, routing, and observability layer of EY’s AI-native platform. You will manage CI/CD pipelines, governance for AI assets, and cost attribution across cloud, on-prem, edge, and air‑gapped environments.

You’ll work across OpenTelemetry, Grafana, Prometheus, and model-serving stacks on GPUs, driving repeatable, auditable AI workloads with strong FinOps discipline. This role embraces hybrid/remote work in the US.