AI Systems Engineer - DevOps, Model Serving & Observability

EY; Las Vegas (NV); Hybrid; USD 107,000 - 177,000; Full time

Benefits offered by this job

Hybrid work model

Job summary

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability across EY’s AI-native platform. You will design and operate CI/CD/CV pipelines, governance for AI assets, cost attribution, and comprehensive observability spanning cloud, on-prem, edge, and air-gapped environments.

The role sits at the intersection of DevOps, MLOps, FinOps, and observability, requiring hands-on leadership in production AI workloads and secure model execution.

Qualifications

• 8+ years in DevOps, MLOps, platform, or observability engineering with hands-on production ownership of AI or high-throughput services.

Responsibilities

• Supports DevOps and delivery for AI workloads: build and operate CI/CD/CV pipelines that ship AI services, agents, and runtime components, including automated build, test, verification, release, and rollback.
• Own governance and discovery for AI assets and model metadata with registries and lineage tracking.
• Own resource and cost management with quotas and cost attribution.
• Own the full observability stack: metrics, logs, traces, dashboards, and debugging tools.
• Own the OpenTelemetry collection layer for multi-tenant signals and reliable routing.
• Automate GitOps-based delivery and policy-driven quality gates in pipelines.
• Close the loop between delivery and observability with telemetry and cost signals for deployment decisions and automated rollbacks.
• Ensure cost and telemetry are per-tenant and attributable to workloads for FinOps and observability.

Skills

DevOps

MLOps

Observability

GitOps

CI/CD

GPU inference

LangSmith

Langfuse

OpenTelemetry

Education

Bachelor’s or Master’s in Computer Science

Tools

ArgoCD

Helm

GitHub Actions

GitLab CI

Ray Serve

vLLM

Triton

NIM

Prometheus

Grafana

Loki

Tempo/Jaeger

OpenLineage

OpenCost

Kubecost

Harbor

MLflow

Trivy

Envoy

DCGM

Job description

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability across EY’s AI-native platform. You will design and operate CI/CD/CV pipelines, governance for AI assets, cost attribution, and comprehensive observability spanning cloud, on-prem, edge, and air-gapped environments.

The role sits at the intersection of DevOps, MLOps, FinOps, and observability, requiring hands-on leadership in production AI workloads and secure model execution.