AI Systems Engineer: DevOps, Observability & FinOps

Ernst & Young Oman; Honolulu (HI); Hybrid; USD 107,000 - 177,000; Full time

Job summary

EY seeks an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of EY’s AI-native platform. You will oversee CI/CD pipelines, governance of AI assets, and cost-aware deployment across cloud, on-prem, edge, and air-gapped environments.

This role sits at the crossroads of DevOps, MLOps, FinOps, and observability, requiring strong collaboration with senior engineers and cross-functional teams. Hybrid work model offered in the US.

Qualifications

• 8+ years in DevOps, MLOps, platform, or observability engineering, with hands-on ownership of AI or high-throughput services.

Responsibilities

• Supports DevOps and delivery for AI workloads: build and operate CI/CD/CV pipelines that ship AI services and runtime components.
• Own governance and discovery for AI assets, including registries, experiment tracking, and license management.
• Own resource and cost management to keep AI execution economically bounded per tenant.
• Own the full observability stack: metrics, logs, traces, dashboards, and AI evaluation tooling.
• Automate GitOps-based delivery and verification, embedding cost and quality gates.
• Close the loop between delivery and observability using telemetry and cost signals for deployment decisions.
• Ensure cost and telemetry are identity-stamped per-tenant to tie FinOps to workloads.

Skills

CI/CD/CV pipelines

GitOps

OpenTelemetry

Prometheus

Grafana

Loki

Tempo/Jaeger

LangSmith

Langfuse

Envoy

OpenCost

Kubecost

Harbor

MLflow

Trivy

OpenLineage

Harbor/Nexus

Ray Serve

vLLM

Triton

NIM

HuggingFace

GPU inference

Education

Bachelor’s or Master’s degree in Computer Science or related field

Tools

Harbor

MLflow

Trivy

OpenLineage

Prometheus

Grafana

Loki

Tempo/Jaeger

Ray Serve

vLLM

Triton

NIM

LangSmith

Langfuse

Envoy

Job description

EY seeks an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of EY’s AI-native platform. You will oversee CI/CD pipelines, governance of AI assets, and cost-aware deployment across cloud, on-prem, edge, and air-gapped environments.

This role sits at the crossroads of DevOps, MLOps, FinOps, and observability, requiring strong collaboration with senior engineers and cross-functional teams. Hybrid work model offered in the US.