Senior AI Platform Engineer: Observability & FinOps

EY; McLean (VA); Hybrid; USD 107,000 - 177,000; Full time

Benefits offered by this job

Hybrid work model

Total Rewards package (medical, dental

Pension and 401(k) plans

Job summary

EY in the United States is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability for EY’s AI-native platform. You will help ship reliable AI workloads across hybrid cloud, on‑prem, edge, and air‑gapped environments.

Collaborate with DevOps, MLOps, and platform teams to design CI/CD/CV pipelines, asset governance, cost attribution, and telemetry. Ensure releases are repeatable, auditable, and cost-aware end‑to‑end.

Qualifications

• 8+ years in DevOps, MLOps, platform, or observability engineering with hands-on ownership of AI or high-throughput services.
• Strong hands-on DevOps experience for automated build, test, release, and rollback.
• Hands-on expertise operating inference/model-serving frameworks on GPU infrastructure.
• Strong experience with observability stacks and OpenTelemetry.
• Experience with API gateways and request routing, including streaming responses.
• Experience with cost management / FinOps tooling and quota/rate-limit enforcement.
• Familiarity with model/artifact registries and governance tools.
• Proven track record operating AI infrastructure under regulatory constraints.

Responsibilities

• Supports DevOps and delivery for AI workloads: build, test, verify, release, and rollback across environments.
• Own governance and discovery for AI assets and registries (Harbor, MLflow, Trivy, OpenLineage).
• Own resource and cost management with attribution to tenants and engagements.
• Own the full observability stack: metrics, logs, traces, dashboards, and SLA/alerts.
• Automate GitOps-based delivery with policy-driven gates.
• Close the loop between delivery and observability using telemetry and cost signals.

Skills

CI/CD/CV pipelines

GitOps tooling

OpenTelemetry

Cost attribution / FinOps

Model-serving governance

Observability stacks

API gateways / routing

Education

Bachelor’s or Master’s degree in Computer Science or related field

Tools

Ray Serve

vLLM/Triton/NIM

Prometheus/Grafana/Loki/Tempo/Jaeger

Envoy

Job description

EY in the United States is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability for EY’s AI-native platform. You will help ship reliable AI workloads across hybrid cloud, on‑prem, edge, and air‑gapped environments.

Collaborate with DevOps, MLOps, and platform teams to design CI/CD/CV pipelines, asset governance, cost attribution, and telemetry. Ensure releases are repeatable, auditable, and cost-aware end‑to‑end.