AI Platform Reliability Engineer & Observability Lead

EY; San Jose (CA); Hybrid; USD 126,000 - 230,000; Full time

Job summary

EY is seeking an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of EY’s AI-native platform. This role spans CI/CD, governance, cost management, and telemetry across cloud, on-prem, edge, and air-gapped environments.

The ideal candidate will have 8+ years in DevOps/MLOps with hands-on GPU inference and strong OpenTelemetry experience, able to operate across hybrid environments with a focus on secure, economical AI workloads.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related technical field.
• 8+ years in DevOps, MLOps, platform, or observability engineering with production ownership of AI workloads.
• Strong hands-on DevOps experience with CI/CD/CV pipelines and GitOps tooling.
• Hands-on expertise operating inference/model-serving frameworks on GPU infrastructure.
• Strong observability stacks and OpenTelemetry experience.
• Experience with API gateways and request routing incl. streaming responses.
• Experience with cost management tooling and quota/rate-limit enforcement.
• Familiarity with model/artifact registries and governance.

Responsibilities

• Own DevOps and delivery for AI workloads: CI/CD/CV pipelines and rollback for all environments.
• Own governance and discovery for AI assets, including registries and metadata.
• Own resource and cost management with quotas and attribution per tenant.
• Own the full observability stack: metrics, logs, traces, dashboards, and evaluation.
• Own OpenTelemetry collection layer and multi-tenant signal routing.
• Automate GitOps-based delivery and embed quality and cost gates into pipelines.
• Close the loop between delivery and observability using telemetry and cost signals.
• Ensure identity-stamped telemetry for per-tenant consumption.

Skills

DevOps

MLOps

Observability

FinOps

Cloud

Communication

Education

Bachelor’s or Master’s degree in CS or related field

Tools

Ray Serve

vLLM

Triton

NIM

OpenTelemetry

Job description

EY is seeking an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of EY’s AI-native platform. This role spans CI/CD, governance, cost management, and telemetry across cloud, on-prem, edge, and air-gapped environments.

The ideal candidate will have 8+ years in DevOps/MLOps with hands-on GPU inference and strong OpenTelemetry experience, able to operate across hybrid environments with a focus on secure, economical AI workloads.