AI Systems Engineer: Observability, Delivery & FinOps

EY; Baton Rouge (LA); Hybrid; USD 107,000 - 177,000; Full time

Benefits offered by this job

Hybrid work model

Medical and dental coverage

Pension and 401(k) plans

Paid time off options

Job summary

EY seeks an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of its AI‑native platform across cloud, on‑prem, edge, and air‑gapped environments. You will shape how AI services are built, deployed, and governed, working with senior engineers to test and develop capabilities.

This role blends DevOps, MLOps, FinOps, and observability, requiring strong expertise in automated delivery, high‑performance inference, and cost visibility end‑to‑end.

Qualifications

• 8+ years in DevOps, MLOps, platform, or observability engineering with production ownership.
• Hands-on CI/CD/CV pipelines and GitOps tooling for automated delivery.
• Experience operating GPU‑based inference and model serving at scale.
• Strong observability stack knowledge (Prometheus, Grafana, Loki, Tempo/Jaeger).
• Familiar with cost management tools and quota/rate‑limit enforcement.
• Experience with model/artifact registries and supply‑chain scanning.

Responsibilities

• Own the delivery, routing, and observability layer for AI workloads.
• Operate CI/CD/CV pipelines and GitOps to enable repeatable releases.
• Govern AI assets, registries, and experiment tracking across environments.
• Manage cost attribution and utilization per tenant and workload.
• Maintain full observability stack and SLA/alerting for AI services.
• Implement OpenTelemetry collection, multi‑tenant telemetry routing.

Skills

DevOps engineering

MLOps

Observability

FinOps

OpenTelemetry

Cost attribution

Model serving

Cloud and on‑prem

Education

Bachelor’s or Master’s in CS or related

Tools

Ray Serve

vLLM

Triton

NIM

Prometheus

Grafana

Loki

Tempo/Jaeger

Envoy

Harbor

MLflow

Trivy

OpenLineage

Job description

EY seeks an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of its AI‑native platform across cloud, on‑prem, edge, and air‑gapped environments. You will shape how AI services are built, deployed, and governed, working with senior engineers to test and develop capabilities.

This role blends DevOps, MLOps, FinOps, and observability, requiring strong expertise in automated delivery, high‑performance inference, and cost visibility end‑to‑end.