AI Platform Engineer: DevOps, Observability & FinOps

EY; Orlando (FL); Hybrid; USD 107,000 - 177,000; Full time

Benefits offered by this job

Hybrid work model

Medical & dental coverage

Pension and 401(k)

Paid time off

Job summary

EY seeks an AI Systems Engineer to own delivery, model-serving, routing, and observability across EY’s AI-native platform. You’ll shape how AI services are built and deployed, with governance, cost awareness, and telemetry at the heart of every deployment.

You will partner across platform, trust, and data teams, operating in a hybrid, multi-environment setting (cloud, on-prem, edge). Candidates should bring 8+ years in DevOps/MLOps and strong cost and observability skills.

Qualifications

• 8+ years in DevOps, MLOps, platform, or observability engineering with ownership of AI or high-throughput services.
• Hands-on DevOps experience with CI/CD/CV pipelines and GitOps tooling for automated build/test/release/rollback.
• Hands-on expertise with inference/model-serving frameworks on GPU infrastructure.
• Strong observability skills across metrics, logs, traces, and OpenTelemetry.
• Experience with API gateways and request routing, including streaming responses.
• Experience with FinOps tooling and quota/rate-limit enforcement.
• Familiarity with model/artifact registries and supply-chain scanning.

Responsibilities

• Supports DevOps and delivery for AI workloads; CI/CD/CV pipelines, release, rollback.
• Own governance and discovery for AI assets and model metadata.
• Own resource and cost management with quotas and attribution.
• Own the full observability stack including metrics, logs, traces, dashboards.
• Own OpenTelemetry collection layer for multi-tenant environments.
• Automate GitOps-based delivery and verification with policy gates.
• Drive deployment decisions with telemetry and cost signals for rollback.
• Ensure per-tenant cost and telemetry are captured end-to-end.

Skills

DevOps & MLOps

Observability

FinOps / cost attribution

Model/artifact governance

Multi-environment runtime

OpenTelemetry

Strong communicator

Education

Bachelor's or Master’s in CS or related

Tools

ArgoCD

Helm

GitHub Actions/GitLab CI

Ray Serve / vLLM / Triton / NIM

Prometheus / Grafana / Loki / Tempo / Jaeger

OpenTelemetry

Harbor / MLflow / Trivy

Envoy / API gateways

Kubecost / OpenCost

Job description

EY seeks an AI Systems Engineer to own delivery, model-serving, routing, and observability across EY’s AI-native platform. You’ll shape how AI services are built and deployed, with governance, cost awareness, and telemetry at the heart of every deployment.

You will partner across platform, trust, and data teams, operating in a hybrid, multi-environment setting (cloud, on-prem, edge). Candidates should bring 8+ years in DevOps/MLOps and strong cost and observability skills.