AI Platform Delivery & Observability Lead

EY; Philadelphia (Philadelphia County); Hybrid; USD 126,000 - 230,000; Full time

Benefits offered by this job

Hybrid work model

Total Rewards package

Job summary

EY seeks an AI Systems Engineer to own delivery, model-serving, routing, and observability for EY’s AI-native platform across cloud, on-prem, edge, and air-gapped environments. You’ll build CI/CD/CV pipelines, manage governance and cost, and ensure secure model execution.

You will work across DevOps, MLOps, FinOps, and observability to deliver repeatable workloads, with strong emphasis on telemetry and cost attribution per tenant. This hybrid role offers growth in a global, diverse team.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related technical field.
• 8+ years in DevOps, MLOps, platform, or observability engineering with production ownership of AI or high-throughput services.
• Hands-on DevOps experience with CI/CD/CV pipelines and GitOps tooling for automated build, test, release, and rollback.
• Hands-on expertise operating inference/model-serving frameworks on GPU infrastructure.
• Strong observability stack experience and OpenTelemetry.

Responsibilities

• Own DevOps and delivery for AI workloads: CI/CD/CV pipelines for AI services and runtime components.
• Own governance and discovery for AI assets and registries, model metadata, and SBOM scanning.
• Own resource and cost management with quotas and cost attribution per tenant.
• Own the full observability stack: metrics, logs, traces, dashboards, and AI debugging/evaluation.

Education

Bachelor’s or Master’s degree in Computer Science or related technical field

Tools

Ray Serve

vLLM

Triton

NIM

Prometheus

Grafana

Loki

Tempo/Jaeger

Harbor

MLflow

Trivy

Kubecost/OpenCost

Job description

EY seeks an AI Systems Engineer to own delivery, model-serving, routing, and observability for EY’s AI-native platform across cloud, on-prem, edge, and air-gapped environments. You’ll build CI/CD/CV pipelines, manage governance and cost, and ensure secure model execution.

You will work across DevOps, MLOps, FinOps, and observability to deliver repeatable workloads, with strong emphasis on telemetry and cost attribution per tenant. This hybrid role offers growth in a global, diverse team.