AI Platform Engineer: DevOps, Observability & FinOps

EY; Tampa (FL); On-site; USD 126,000 - 230,000; Full time

Benefits offered by this job

Hybrid work model

Flexible vacation policy

Medical and dental coverage

Pension and 401(k)

Paid time off options

Job summary

EY is seeking an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of EY’s AI-native platform. You will manage CI/CD pipelines, governance, cost visibility, and end-to-end observability across cloud, on‑prem, edge, and air‑gapped environments.

The role sits at the intersection of DevOps, MLOps, FinOps, and observability, requiring hands‑on experience with AI workloads, GPU inference, and multi‑tenant governance.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related field.
• 8+ years in DevOps, MLOps, platform, or observability engineering with ownership of AI or high-throughput services.
• Hands-on DevOps experience with CI/CD/CV pipelines and GitOps tooling for automated build, test, release, rollback.
• Hands-on expertise operating inference/model-serving frameworks on GPU infrastructure.
• Strong observability experience and knowledge of OpenTelemetry, Prometheus, Grafana, Loki, Tempo/Jaeger.
• Experience with API gateways and request routing, including streaming responses.
• Experience with cost management tools (OpenCost, Kubecost) and quota enforcement.
• Familiarity with model/artifact registries and supply-chain scanning.

Responsibilities

• Own DevOps and delivery for AI workloads: CI/CD/CV pipelines, release, and rollback.
• Own governance and discovery for AI assets, including registries and metadata.
• Own resource and cost management with per-tenant attribution and quotas.
• Own full observability stack: metrics, logs, traces, dashboards.
• Own OpenTelemetry collection layer and multi-tenant routing.
• Automate GitOps-based delivery and embed quality and cost gates into pipelines.
• Close delivery and observability loop to drive deployment decisions and rollbacks.
• Ensure consumption is attributable and FinOps-aligned end-to-end.

Skills

DevOps / CI-CD pipelines

MLOps

Observability

FinOps / cost attribution

OpenTelemetry

Education

Bachelor’s or Master’s in CS or related field

Tools

Ray Serve

vLLM / Triton / NIM

Envoy API gateway

Prometheus / Grafana / Loki / Tempo / Jaeger

OpenTelemetry

Harbor / MLflow / Trivy

ArgoCD / Helm / GitHub Actions / GitLab CI

Kubecost / OpenCost

Job description

EY is seeking an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of EY’s AI-native platform. You will manage CI/CD pipelines, governance, cost visibility, and end-to-end observability across cloud, on‑prem, edge, and air‑gapped environments.

The role sits at the intersection of DevOps, MLOps, FinOps, and observability, requiring hands‑on experience with AI workloads, GPU inference, and multi‑tenant governance.