AI Platform Engineer: DevOps, Observability & Governance

EY; Birmingham (AL); Remote; USD 107,000 - 177,000; Full time

Benefits offered by this job

Hybrid work model

Flexible vacation

Total rewards

Job summary

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability for EY's AI-native platform in a remote US setting. You will shape the runtime surface, governance, cost visibility, and telemetry across cloud, on-prem, edge, and air-gapped environments, working with DevOps, MLOps, and security teams.

The role emphasizes building automated pipelines, secure model execution, and end-to-end observability, with collaboration across platform, trust, and data teams.

Qualifications

• 8+ years in DevOps, MLOps, platform, or observability engineering with production ownership of AI or high-throughput services.

Responsibilities

• Supports DevOps and delivery for AI workloads: build and operate CI/CD/CV pipelines that ship AI services, agents, and runtime components.
• Own governance and discovery for AI assets, including service catalog/registry, experiment tracking, and model metadata.
• Own resource and cost management, including quotas and rate limits, cost attribution and utilization.
• Own the full observability stack, including metrics, logs, traces, dashboards, and AI debugging tools.
• Own the OpenTelemetry collection layer and multi-tenant signal routing.
• Automate GitOps-based delivery and continuous verification with policy gates.
• Close the loop between delivery and observability using telemetry and cost signals for deployment decisions.
• Ensure cost and telemetry are identity-stamped and per-tenant.

Skills

DevOps

MLOps

Observability

OpenTelemetry

GitOps

FinOps

API gateways

Compliance

Multi-tenant

GPU inference

Education

Bachelor's degree in Computer Science or related field

Tools

Ray Serve

vLLM

Triton

NIM

Prometheus

Grafana

Job description

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability for EY's AI-native platform in a remote US setting. You will shape the runtime surface, governance, cost visibility, and telemetry across cloud, on-prem, edge, and air-gapped environments, working with DevOps, MLOps, and security teams.

The role emphasizes building automated pipelines, secure model execution, and end-to-end observability, with collaboration across platform, trust, and data teams.