AI Platform DevOps Engineer — Observability & FinOps

EY; Arlington (VA); Hybrid; USD 107,000 - 177,000; Full time

Benefits offered by this job

Hybrid work model

Medical and dental coverage

401(k)

Job summary

EY is seeking an AI Systems Engineer to own delivery, model serving, routing, and observability for EY’s AI‑native platform. You will shape the runtime surface across cloud, on‑prem, edge, and air‑gapped environments, building automated pipelines and secure model execution.

You will work across DevOps, MLOps, FinOps, and observability, owning cost controls, telemetry, and governance for AI workloads at scale.

Qualifications

• 8+ years in DevOps, MLOps, platform, or observability engineering with production ownership of AI/high‑throughput services.
• Hands‑on CI/CD/CV pipelines and GitOps tooling for automated build, test, release, rollback.
• Hands‑on expertise operating inference/model‑serving frameworks on GPU infrastructure.
• Strong observability experience with metrics/logs/traces and OpenTelemetry.
• Experience with API gateways and request routing including streaming responses.
• Experience with FinOps tooling and quota/rate‑limit enforcement.
• Familiarity with model/artifact registries and supply‑chain scanning.
• Proven track record under compliance, security, or regulatory constraints.

Responsibilities

• Supports DevOps and delivery for AI workloads: CI/CD/CV pipelines, automated build, test, release, and rollback.
• Own governance and discovery for AI assets and model metadata.
• Own resource and cost management with quotas and attribution.
• Own full observability stack: metrics, logs, traces, dashboards, LLMevaluation.
• Own OpenTelemetry collection including multi‑tenant receivers and GPU telemetry.
• Automate GitOps‑based delivery and embed quality and cost gates.
• Tie delivery to observability and cost signals for deployment decisions and rollbacks.
• Ensure per‑tenant identity stamping for FinOps and observability.

Skills

DevOps mastery

GitOps tooling

Model serving frameworks

Observability

FinOps mindset

Governance

Cross-team communication

Platform ownership

Education

Bachelor’s degree in CS or related

Tools

Ray Serve

vLLM/Triton/NIM

Prometheus/Grafana/Loki/Tempo/Jaeger

Envoy

OpenTelemetry

Harbor/MLflow/Trivy

Job description

EY is seeking an AI Systems Engineer to own delivery, model serving, routing, and observability for EY’s AI‑native platform. You will shape the runtime surface across cloud, on‑prem, edge, and air‑gapped environments, building automated pipelines and secure model execution.

You will work across DevOps, MLOps, FinOps, and observability, owning cost controls, telemetry, and governance for AI workloads at scale.