AI Systems Engineer: DevOps, Delivery & Observability

EY; Portland (OR); On-site; USD 107,000 - 177,000; Full time

Benefits offered by this job

Hybrid work model

Total Rewards package

Job summary

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability across EY's AI-native platform. You will shape the runtime surface, govern AI assets, and ensure secure, cost‑aware execution in cloud, on‑prem, edge, and air‑gapped environments.

The role sits at the intersection of DevOps, MLOps, FinOps, and observability, requiring deep expertise in CI/CD, GPU inference, and OpenTelemetry. EY offers hybrid work and a comprehensive rewards package.

Qualifications

• 8+ years in DevOps, MLOps, platform, or observability engineering with hands-on ownership of AI or high-throughput services.
• Hands-on CI/CD/CV pipelines and GitOps tooling (ArgoCD, Helm, GitHub Actions/GitLab CI) for automated build, test, release, and rollback.
• Experience with inference/model-serving frameworks on GPU infrastructure and OpenTelemetry observability.

Responsibilities

• Own delivery pipelines and CV/CI tooling for AI workloads.
• Own governance and discovery for AI assets and registries.
• Manage cost attribution and quotas to keep AI workloads economical.
• Own the full observability stack: metrics, logs, traces, dashboards.
• Maintain OpenTelemetry collection and multi-tenant data routing.
• Automate GitOps-based delivery with policy gates.
• Close the loop between delivery and observability using telemetry and cost signals.
• Ensure per-tenant identity stamping for FinOps alignment.

Skills

DevOps

MLOps

Observability

GitOps

Cost management

API gateways

Multi-tenant

Education

Bachelor's or Master's in CS or related field

Tools

Ray Serve

vLLM

Triton

NIM

Prometheus

Grafana

Loki

Tempo

Jaeger

OpenTelemetry

Envoy

Harbor

MLflow

Trivy

OpenLineage

Job description

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability across EY's AI-native platform. You will shape the runtime surface, govern AI assets, and ensure secure, cost‑aware execution in cloud, on‑prem, edge, and air‑gapped environments.

The role sits at the intersection of DevOps, MLOps, FinOps, and observability, requiring deep expertise in CI/CD, GPU inference, and OpenTelemetry. EY offers hybrid work and a comprehensive rewards package.