AI Systems Engineer: DevOps, Observability & AI Delivery

Ernst & Young Oman; Salem (OR); Hybrid; USD 107,000 - 177,000; Full time

Benefits offered by this job

Hybrid work model

Competitive compensation

Comprehensive benefits

Flexible vacation policy

Paid holidays

Job summary

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability of its AI-native platform across cloud, on-prem, edge, and air-gapped environments. You will shape how AI services are built, deployed, and governed, collaborating with senior engineers to test and extend capabilities.

This role sits at the intersection of DevOps, MLOps, FinOps, and observability, requiring strong pipelines, GPU inference expertise, and a cost-aware mindset to deliver repeatable,

Qualifications

• 8+ years in DevOps/MLOps/platform or observability engineering with AI ownership.
• Hands-on CI/CD/CV pipelines and GitOps tooling for automated delivery.
• Expertise operating inference/model-serving frameworks on GPUs.
• Strong observability with Prometheus/Grafana/Loki and OpenTelemetry.
• Experience with API gateways and request routing (Envoy).
• Familiarity with FinOps and cost attribution tooling.
• Knowledge of registries and supply-chain scanning.
• Proven ability to operate under regulatory constraints.
• Ability to define clear ownership boundaries with platform, trust, and data teams.

Responsibilities

• Supports DevOps and delivery for AI workloads: CI/CD/CV pipelines and release.
• Own governance and discovery for AI assets and model metadata.
• Own resource and cost management per tenant and engagement.
• Own the full observability stack including metrics, logs, and traces.
• Own the OpenTelemetry collection layer across environments.
• Automate GitOps-based delivery with policy- gates in pipelines.
• Close the loop between delivery and observability using telemetry and cost signals.
• Ensure per-tenant identity stamping and accountability of usage.

Skills

DevOps

MLOps

OpenTelemetry

GitOps

CI/CD pipelines

GPU inference

FinOps

Model governance

API gateways

Education

Bachelor’s or Master’s in CS

Tools

ArgoCD

Helm

GitHub Actions

GitLab CI

Ray Serve

vLLM

Triton

NIM

Prometheus

Grafana

Loki

Tempo/Jaeger

LangSmith

Langfuse

Harbor

MLflow

Trivy

OpenLineage

OpenCost

Kubecost

Job description

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability of its AI-native platform across cloud, on-prem, edge, and air-gapped environments. You will shape how AI services are built, deployed, and governed, collaborating with senior engineers to test and extend capabilities.

This role sits at the intersection of DevOps, MLOps, FinOps, and observability, requiring strong pipelines, GPU inference expertise, and a cost-aware mindset to deliver repeatable,