AI Delivery & Observability Engineer

Ernst & Young Oman; Nashville (TN); Hybrid; USD 107,000 - 177,000; Full time

Benefits offered by this job

Hybrid work model

Comprehensive compensation & benefits

Paid time off / vacation policy

Job summary

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing and observability across EY\'s hybrid AI platform. This role sits at the intersection of DevOps, MLOps, FinOps and observability, spanning cloud, on-prem, edge and air-gapped environments.

You will build automated delivery pipelines, operate high-performance inference, and enable cost visibility, governance and telemetry while ensuring repeatable deployments and regulatory compliance across environments.

Qualifications

• 8+ years in DevOps, MLOps, platform, or observability engineering with hands-on AI/workload ownership.
• Hands-on DevOps experience with CI/CD/CV pipelines and GitOps tooling for automated build, test, release, and rollback.
• Experience operating inference/model-serving frameworks on GPU infrastructure.
• Strong observability experience across metrics, logs, traces, and OpenTelemetry.
• Familiarity with model/artifact registries and supply-chain scanning.
• Proven ability to work under regulatory or security constraints.

Responsibilities

• Supports DevOps and delivery for AI workloads with CI/CD/CV pipelines.
• Own governance and discovery for AI assets and registries.
• Own resource and cost management with quotas and attribution.
• Own the full observability stack including metrics, logs, traces, and dashboards.
• Own the OpenTelemetry collection layer for multi-tenant environments.
• Automate GitOps-based delivery with policy gates.
• Bridge delivery and observability using telemetry and cost signals to guide deployment.
• Ensure identity-stamped cost and telemetry per tenant.

Skills

DevOps & MLOps for AI workloads

CI/CD/CV pipelines & GitOps

Inference/model-serving frameworks

Observability stacks & OpenTelemetry

Cost management / FinOps tooling

Model/artifact registries & scanning

Education

Bachelor’s or Master’s degree in Computer Science

Tools

Ray Serve

vLLM

Triton

NIM

Prometheus

Grafana

Loki

Tempo/Jaeger

LangSmith

Langfuse

Envoy

ArgoCD

Helm

GitHub Actions

GitLab CI

MLflow

Trivy

OpenLineage

Job description

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing and observability across EY\'s hybrid AI platform. This role sits at the intersection of DevOps, MLOps, FinOps and observability, spanning cloud, on-prem, edge and air-gapped environments.

You will build automated delivery pipelines, operate high-performance inference, and enable cost visibility, governance and telemetry while ensuring repeatable deployments and regulatory compliance across environments.