AI Platform DevOps & Observability Engineer

EY; Sacramento (CA); On-site; USD 107,000 - 177,000; Full time

Benefits offered by this job

Hybrid/Remote work flexibility

Medical & dental coverage

Pension & 401(k)

Job summary

EY is seeking an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of EY’s AI-native platform. You will work across cloud, on-prem, edge, and air-gapped environments, building automated pipelines and governance for repeatable AI workloads.

You will lead cost attribution, telemetry, and multi-tenant governance while collaborating with DevOps, MLOps, and trust teams. EY offers a hybrid, policy-driven delivery model and extensive Total Rewards.

Qualifications

• 8+ years in DevOps, MLOps, platform, or observability engineering with production ownership of AI workloads.
• Strong hands-on DevOps experience with CI/CD/CV pipelines and GitOps tooling (ArgoCD, Helm, GitHub Actions/GitLab CI).
• Hands-on expertise operating inference/model-serving frameworks on GPU infrastructure.
• Strong observability stack experience (Prometheus, Grafana, Loki, Tempo/Jaeger) and OpenTelemetry.
• Familiarity with API gateways and request routing (Envoy) including streaming responses.
• Experience with cost management / FinOps tooling and quota/rate-limit enforcement.
• Familiarity with model/artifact registries and supply-chain scanning.
• Proven track record in regulated delivery environments.

Responsibilities

• Supports DevOps and delivery for AI workloads: build and operate CI/CD/CV pipelines that ship AI services and runtime components, including automated build, test, verification, release, and rollback.
• Own governance and discovery for AI assets: registries, experiment tracking, model metadata, and license management.
• Own resource and cost management to keep AI execution economically bounded per tenant and engagement.
• Own the full observability stack: metrics, logs, traces, dashboards, and SLA/alerting.
• Own the OpenTelemetry collection layer for multi-tenant routing and GPU telemetry.
• Automate GitOps-based delivery and verification with policy gates by default.

Skills

DevOps & MLOps

GitOps tooling

Ray Serve

OpenTelemetry

FinOps tooling

Model registries

Regulated environments

Cost attribution

Education

Bachelor's/Master's in CS

Tools

Envoy

MLflow

Trivy

OpenLineage

HuggingFace

Job description

EY is seeking an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of EY’s AI-native platform. You will work across cloud, on-prem, edge, and air-gapped environments, building automated pipelines and governance for repeatable AI workloads.

You will lead cost attribution, telemetry, and multi-tenant governance while collaborating with DevOps, MLOps, and trust teams. EY offers a hybrid, policy-driven delivery model and extensive Total Rewards.