AI Platform Engineer - Delivery & Observability

Ernst & Young Oman; Dallas (TX); Hybrid; USD 107,000 - 177,000; Full time

Job summary

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability for EY’s AI-native platform. You will work across cloud, on-prem, edge, and air-gapped environments, ensuring repeatable, economical AI workloads with policy-driven pipelines.

The role blends DevOps, MLOps, FinOps, and observability, requiring 8+ years of production ownership and strong experience with GPU inference and open telemetry stacks. EY offers hybrid work and a comprehensive rewards package.

Qualifications

• 8+ years in DevOps, MLOps, platform, or observability engineering with production ownership of AI or high-throughput services.
• Hands-on DevOps experience: CI/CD/CV pipelines and GitOps tooling for automated build, test, release, and rollback.
• Hands-on expertise operating inference/model-serving frameworks (Ray Serve, vLLM, Triton, or NIM) on GPU infrastructure.
• Strong observability experience with metrics, logs, traces and OpenTelemetry.
• Experience with cost management/FinOps tooling and quota/rate-limit enforcement.
• Familiarity with model/artifact registries and supply-chain scanning.

Responsibilities

• Supports DevOps and delivery for AI workloads: build and operate CI/CD/CV pipelines that ship AI services and runtime components.
• Own governance and discovery for AI assets, including registries, experiment tracking, and license management.
• Own resource and cost management with quotas and attribution to keep AI execution bounded per tenant.
• Own the full observability stack: metrics, logs, traces, and dashboards for AI workloads.
• Own the OpenTelemetry collection layer across multi-tenant environments.
• Automate GitOps-based delivery and continuous verification with policy gates in pipelines.
• Close the loop between delivery and observability to drive deployment decisions and automated rollback.
• Ensure cost and telemetry are identity-stamped per-tenant for FinOps alignment.

Skills

DevOps

CI/CD

GitOps

Observability

FinOps

Governance

Education

Bachelor’s or Master’s in CS or related field

Tools

Ray Serve

vLLM

Triton

NIM

Job description

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability for EY’s AI-native platform. You will work across cloud, on-prem, edge, and air-gapped environments, ensuring repeatable, economical AI workloads with policy-driven pipelines.

The role blends DevOps, MLOps, FinOps, and observability, requiring 8+ years of production ownership and strong experience with GPU inference and open telemetry stacks. EY offers hybrid work and a comprehensive rewards package.