AI Platform Engineer: End-to-End Deployment & Observability

EY; Sacramento (CA); On-site; USD 126,000 - 230,000; Full time

Benefits offered by this job

Hybrid work model

Medical and dental coverage

Pension and 401(k)

Generous paid time off

Job summary

EY seeks an AI Systems Engineer to own delivery, model-serving, routing, and observability for EY’s AI-native platform across cloud, on‑prem, edge, and air‑gapped environments. You will shape automated pipelines, secure model execution, and cost-aware governance while collaborating across DevOps, MLOps, FinOps, and observability functions.

This role requires strong experience with GPU inference, OpenTelemetry, and multi-tenant cost attribution in regulated contexts; excellent communication with

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related field.
• 8+ years of DevOps, MLOps, platform, or observability engineering with production ownership of AI or high-throughput services.
• Hands-on CI/CD/CV pipelines and GitOps tooling (ArgoCD, Helm, GitHub Actions/GitLab CI).
• Experience with inference/model-serving frameworks on GPU infrastructure.
• Strong observability stack experience and OpenTelemetry.
• Experience with cost management tooling and quota/rate-limiting enforcement.
• Familiarity with model/artifact registries and supply-chain scanning.
• Proven track record delivering under regulatory constraints.

Responsibilities

• Own DevOps and delivery for AI workloads and CI/CD/CV pipelines.
• Own governance and discovery for AI assets and metadata.
• Own resource and cost management with per-tenant attribution.
• Own full observability stack: metrics, logs, traces, dashboards.
• Own OpenTelemetry collection and multi-tenant routing for signals.
• Automate GitOps-based delivery with quality and cost gates.
• Drive deployment decisions with telemetry, evaluation, and automated rollback.
• Ensure consumption is traceable end-to-end across environments.

Skills

DevOps

MLOps

Observability

FinOps

OpenTelemetry

GitOps

Cost attribution

Multi-Environment runtimes

Education

Bachelor’s or Master’s degree in Computer Science

Tools

ArgoCD

Helm

GitHub Actions

GitLab CI

Ray Serve

vLLM/Triton/NIM

Prometheus

Grafana

Loki

Tempo/Jaeger

LangSmith/Langfuse

OpenCost/Kubecost

Harbor/MLflow/Trivy

OpenLineage

Envoy

DCGM

Job description

EY seeks an AI Systems Engineer to own delivery, model-serving, routing, and observability for EY’s AI-native platform across cloud, on‑prem, edge, and air‑gapped environments. You will shape automated pipelines, secure model execution, and cost-aware governance while collaborating across DevOps, MLOps, FinOps, and observability functions.

This role requires strong experience with GPU inference, OpenTelemetry, and multi-tenant cost attribution in regulated contexts; excellent communication with