AI Platform Engineer: DevOps, Observability, FinOps

EY; New Orleans (LA); Hybrid; USD 126,000 - 230,000; Full time

Benefits offered by this job

Hybrid work model

Medical and dental coverage

Pension and 401(k)

Paid time off

Job summary

EY seeks an AI Systems Engineer to own delivery, model-serving, routing, and observability for its AI-native platform. This role spans CI/CD, GitOps, governance, and cost observability across cloud, on‑prem, edge, and air‑gapped environments.

The ideal candidate has 8+ years in DevOps/MLOps, hands-on experience with GPU inference and model-serving frameworks, and strong observability skills. EY offers a hybrid model and a comprehensive rewards package.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related technical field.
• 8+ years in DevOps, MLOps, platform, or observability engineering with hands-on ownership of AI or high-throughput services.
• Hands-on DevOps experience with CI/CD/CV pipelines and GitOps tooling for automated build, test, release, and rollback.
• Hands-on expertise operating inference/model-serving frameworks on GPU infrastructure.
• Strong observability stack experience and OpenTelemetry.
• Experience with API gateways and request routing (Envoy).
• Experience with FinOps tooling and quota/rate-limit enforcement.
• Familiarity with model/artifact registries and supply-chain scanning.

Responsibilities

• Own DevOps and delivery for AI workloads and pipelines to ship services across environments.
• Own governance and discovery for AI assets and model metadata.
• Own resource and cost management with quotas and attribution.
• Own the full observability stack including metrics, logs, traces, and dashboards.
• Own OpenTelemetry collection and multi-tenant routing for signals.
• Automate GitOps-based delivery and enforce policy gates in pipelines.
• Close the loop between delivery and observability using telemetry and cost signals.
• Ensure per-tenant cost attribution and compliance in delivery.

Skills

CI/CD pipelines

GitOps

Observability

OpenTelemetry

Cost governance

Model serving

GPU inference

Envoy/ routing

Multi-cloud / hybrid env

Education

Bachelor’s or Master’s in CS or related field

Tools

ArgoCD

Helm

GitHub Actions/GitLab CI

Ray Serve

vLLM / Triton / NIM

Prometheus / Grafana / Loki / Tempo/Jaeger

Harbor / MLflow / Trivy

OpenLineage

LangSmith / Langfuse

DCGM

Job description

EY seeks an AI Systems Engineer to own delivery, model-serving, routing, and observability for its AI-native platform. This role spans CI/CD, GitOps, governance, and cost observability across cloud, on‑prem, edge, and air‑gapped environments.

The ideal candidate has 8+ years in DevOps/MLOps, hands-on experience with GPU inference and model-serving frameworks, and strong observability skills. EY offers a hybrid model and a comprehensive rewards package.