Senior AI Platform DevOps & Observability Lead

EY; Seattle (WA); Hybrid; USD 126,000 - 230,000; Full time

Benefits offered by this job

Hybrid work model

Medical coverage

Dental coverage

401(k) plan

Job summary

EY seeks an AI Systems Engineer to own delivery, model-serving, routing, and observability for its AI-native platform. You will manage CI/CD pipelines, governance of AI assets, and a cost-aware, observable deployment model across cloud, on-prem, edge, and air-gapped environments.

You will operate GPU inference, implement OpenTelemetry, and drive automated, policy-based releases while collaborating with cross-functional teams to ensure repeatable, compliant AI workloads.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related field.
• 8+ years in DevOps, MLOps, platform, or observability engineering with production ownership of AI workloads.
• Hands-on CI/CD/CV pipelines and GitOps tooling for automated build, test, release, and rollback.
• Experience operating AI/model-serving frameworks on GPU infrastructure.
• Strong observability experience with Prometheus, Grafana, Loki, Tempo/Jaeger, and OpenTelemetry.
• Familiarity with model registries, artifact governance, and cost attribution tooling.

Responsibilities

• Own DevOps and delivery for AI workloads, building CI/CD/CV pipelines and automated release processes.
• Own governance and discovery for AI assets, including registries and metadata tracking.
• Own resource and cost management with quota, rate limits, and cost attribution.
• Own the full observability stack with metrics, logs, traces, and dashboards.
• Own OpenTelemetry collection and multi-tenant signal routing for GPU telemetry.
• Automate GitOps-based delivery with policy gates and automatic rollback.
• Close the loop between delivery and observability for informed deployment decisions.

Skills

DevOps

MLOps

Observability

GitOps

CI/CD

GPU Inference

OpenTelemetry

Education

Bachelor’s or Master’s in CS

Tools

Ray Serve

vLLM

Triton

NIM

Prometheus

Grafana

Loki

Tempo

Jaeger

Envoy

OpenTelemetry

Job description

EY seeks an AI Systems Engineer to own delivery, model-serving, routing, and observability for its AI-native platform. You will manage CI/CD pipelines, governance of AI assets, and a cost-aware, observable deployment model across cloud, on-prem, edge, and air-gapped environments.

You will operate GPU inference, implement OpenTelemetry, and drive automated, policy-based releases while collaborating with cross-functional teams to ensure repeatable, compliant AI workloads.