AI Platform Engineer: DevOps, Observability & FinOps

EY; San Mateo (CA); On-site; USD 126,000 - 262,000; Full time

Benefits offered by this job

Hybrid work model

Total Rewards package

Generous paid time off

Job summary

EY is seeking an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of EY’s AI-native platform. This role spans CI/CD pipelines, governance of AI assets, cost attribution, and full observability across cloud, on‑prem, edge, and air‑gapped environments.

The ideal candidate combines DevOps with MLOps, working across GPU inference, model serving, and secure, compliant delivery.

Qualifications

• Bachelor's or Master's degree in Computer Science or related technical field.
• 8+ years in DevOps, MLOps, platform, or observability engineering with hands-on ownership of AI or high-throughput services.
• Hands-on experience with CI/CD/CV pipelines and GitOps tooling for automated build, test, release, and rollback.
• Hands-on expertise operating inference/model-serving frameworks on GPU infrastructure.
• Strong observability experience with Prometheus, Grafana, Loki, Tempo/Jaeger and OpenTelemetry.
• Experience with API gateways and request routing (Envoy) including streaming responses.
• Familiarity with cost management tools (OpenCost, Kubecost) and quota/rate-limit enforcement.
• Familiarity with model/artifact registries and supply-chain scanning (Harbor, MLflow, Trivy).
• Proven track record operating AI or service infrastructure under regulatory constraints.
• Ability to define clean ownership boundaries and consumption contracts.

Responsibilities

• Own DevOps and delivery for AI workloads via CI/CD/CV pipelines and GitOps for multiple environments.
• Own governance and discovery for AI assets and model metadata (MLflow, registries, Trivy).
• Own resource and cost management with attribution per tenant and engagement.
• Own the full observability stack: metrics, logs, traces, dashboards, and OpenTelemetry integration.
• Own the OpenTelemetry collection layer and signal routing across environments.
• Automate GitOps-based delivery and verification with policy gates in pipelines.
• Close the loop between delivery and observability using telemetry and cost signals for deployment decisions.
• Ensure cost and telemetry are per-tenant and SUV-aligned with FinOps.

Skills

CI/CD pipelines

GitOps

Observability

MLOps

FinOps

GPU inference

LangSmith/Langfuse

OpenTelemetry

Education

Bachelor’s or Master’s in CS

Tools

Ray Serve

vLLM

Triton

NIM

Prometheus

Grafana

Loki

Tempo/Jaeger

OpenTelemetry

MLflow

Harbor

Trivy

Job description

EY is seeking an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of EY’s AI-native platform. This role spans CI/CD pipelines, governance of AI assets, cost attribution, and full observability across cloud, on‑prem, edge, and air‑gapped environments.

The ideal candidate combines DevOps with MLOps, working across GPU inference, model serving, and secure, compliant delivery.