AI Systems Engineer: DevOps, Observability & FinOps

EY; Arlington (VA); Hybrid; USD 107,000 - 177,000; Full time

Job summary

EY seeks an AI Systems Engineer to own delivery, model-serving, routing and observability for EY's AI-native platform across cloud, on-prem, edge and air-gapped environments.

The role sits at the intersection of DevOps, MLOps, FinOps and observability, working with a range of runtimes and governance tools to ensure repeatable, cost-aware AI workloads. EY offers a hybrid model and broad opportunities in a global firm.

Qualifications

• 8+ years in DevOps, MLOps, platform, or observability engineering.
• Hands‑on DevOps experience, including CI/CD/CV pipelines and GitOps tooling.
• Hands‑on expertise operating inference/model‑serving frameworks on GPU infrastructure.
• Strong experience with observability stacks and OpenTelemetry.
• Experience with API gateways and request routing, including streaming responses.
• Experience with cost management / FinOps tooling and quota/rate‑limit enforcement.
• Familiarity with model/artifact registries and supply‑chain scanning.
• Proven track record operating AI or service infrastructure under regulatory constraints.

Responsibilities

• Supports DevOps and delivery for AI workloads: build and operate CI/CD/CV pipelines for AI services and runtimes.
• Own governance and discovery for AI assets including registries and model metadata.
• Own resource and cost management with quotas and attribution per tenant.
• Own the full observability stack: metrics, logs, traces, dashboards.
• Own OpenTelemetry collection layer and multi-tenant telemetry routing.
• Automate GitOps-based delivery and automated verification with policy gates.
• Close the loop between delivery and observability using telemetry and cost signals.
• Ensure consumption is per-tenant and SLA‑driven.

Skills

CI/CD pipelines

GitOps

OpenTelemetry

GPU inference

Observability

Cost attribution

Model governance

Tools

Ray Serve

vLLM

Triton

NIM

Envoy

Prometheus

Grafana

Loki

Tempo

Jaeger

LangSmith

Langfuse

MLflow

Trivy

Harbor

Kubecost

OpenCost

Artifactory

Job description

EY seeks an AI Systems Engineer to own delivery, model-serving, routing and observability for EY's AI-native platform across cloud, on-prem, edge and air-gapped environments.

The role sits at the intersection of DevOps, MLOps, FinOps and observability, working with a range of runtimes and governance tools to ensure repeatable, cost-aware AI workloads. EY offers a hybrid model and broad opportunities in a global firm.