AI Platform DevOps & Observability Lead

EY; Rogers (AR); On-site; USD 126,000 - 230,000; Full time

Job summary

EY seeks an AI Systems Engineer to own delivery, model-serving, routing, and observability for EY’s AI-native platform. You’ll manage CI/CD/CV pipelines, secure model execution, governance, and cost visibility across cloud, on‑prem, edge, and air‑gapped environments.

The role spans DevOps, MLOps, and FinOps, requiring hands-on experience with GPU inference, registries, and OpenTelemetry. Hybrid/remote options offered within EY’s global teams.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related technical field.
• 8+ years in DevOps, MLOps, platform, or observability engineering, with hands-on production ownership of AI or high-throughput services.
• Hands-on DevOps experience with CI/CD/CV pipelines and GitOps tooling for automated build, test, release, and rollback.
• Hands-on expertise operating inference/model-serving frameworks on GPU infrastructure.
• Strong observability experience with Prometheus, Grafana, Loki, Tempo/Jaeger and OpenTelemetry.
• Experience with API gateways and request routing (Envoy) and streaming responses.
• Experience with FinOps tooling and quota/rate-limit enforcement.
• Familiarity with model/artifact registries and supply-chain scanning.

Responsibilities

• Own DevOps and delivery for AI workloads and pipelines for shipping AI services and runtime components.
• Own governance and discovery for AI assets and model metadata.
• Own resource and cost management to keep AI execution bounded per tenant.
• Own the full observability stack including metrics, logs, traces, dashboards, and SLA alerts.
• Own the OpenTelemetry collection layer across multi-tenant environments.
• Automate GitOps-based delivery and embed quality, integrity, and cost gates in pipelines.
• Drive decisions with telemetry, evaluation, and cost signals for rollout and rollback.
• Ensure cost and telemetry are identity-stamped and per-tenant across workloads.

Skills

DevOps

MLOps

Observability

GitOps

OpenTelemetry

GPU inference

Cost attribution

Model governance

Communication

Education

Bachelor’s or Master’s in Computer Science

Tools

Ray Serve

vLLM

Triton

NIM

Prometheus

Grafana

Loki

Tempo/Jaeger

Job description

EY seeks an AI Systems Engineer to own delivery, model-serving, routing, and observability for EY’s AI-native platform. You’ll manage CI/CD/CV pipelines, secure model execution, governance, and cost visibility across cloud, on‑prem, edge, and air‑gapped environments.

The role spans DevOps, MLOps, and FinOps, requiring hands-on experience with GPU inference, registries, and OpenTelemetry. Hybrid/remote options offered within EY’s global teams.