AI Systems Engineer & DevOps: Delivery & Observability Lead

Ernst & Young Oman; Nashville (TN); On-site; USD 126,000 - 230,000; Full time

Benefits offered by this job

Medical and dental coverage

Pension and 401(k)

Paid time off

Hybrid work model

Job summary

EY is recruiting an AI Systems Engineer to own delivery, model-serving, routing, and observability for EY’s AI-native platform. You will oversee CI/CD pipelines, governance of AI assets, and scalable cost/telemetry practices across cloud, on-prem, edge, and air-gapped environments.

The role sits at the intersection of DevOps, MLOps, FinOps, and observability, requiring strong GPU inference experience and multi-tenant cost optimization. A hybrid, flexible environment is offered by EY.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or a related field.
• 8+ years in DevOps, MLOps, platform, or observability engineering with production AI ownership.
• Hands-on CI/CD/CV pipelines and GitOps tooling (ArgoCD, Helm, GitHub Actions/GitLab CI).
• Hands-on expertise operating AI model-serving frameworks on GPU infrastructure (Ray Serve, vLLM, Triton, NIM).
• Strong observability experience with Prometheus, Grafana, Loki, Tempo/Jaeger, and OpenTelemetry.
• Experience with API gateways and request routing (Envoy), including streaming responses.
• Familiarity with cost management tools (OpenCost, Kubecost) and quota enforcement.
• Familiarity with model registries, registration, scanning (Harbor, MLflow, Trivy).
• Proven track record operating AI infrastructure under regulatory constraints.
• Ability to define ownership boundaries with platform, trust, and data teams.

Responsibilities

• Own DevOps and delivery for AI workloads including CI/CD/CV pipelines and automated releases.
• Own governance and discovery for AI assets and registries.
• Own resource and cost management with quotas and attribution.
• Own the full observability stack including metrics, logs, traces, dashboards.
• Own the OpenTelemetry collection layer for multi-tenant telemetry.
• Automate GitOps-based delivery with policy gates.
• Close the loop between delivery and observability using telemetry and cost signals.
• Ensure cost and telemetry are per-tenant and attributable to workloads.

Skills

DevOps expertise

Model serving on GPUs

OpenTelemetry observability

FinOps / cost attribution

Governance & registries

Cloud/on-prem/edge versatility

Effective communication

Education

Bachelor’s or Master’s degree in Computer Science or related field

Tools

ArgoCD

Helm

GitHub Actions

GitLab CI

Ray Serve

vLLM

Triton

NIM

Envoy

Prometheus

Grafana

Loki

Tempo/Jaeger

OpenTelemetry

Harbor

MLflow

Trivy/SBOM

OpenCost/Kubecost

DCGM

Job description

EY is recruiting an AI Systems Engineer to own delivery, model-serving, routing, and observability for EY’s AI-native platform. You will oversee CI/CD pipelines, governance of AI assets, and scalable cost/telemetry practices across cloud, on-prem, edge, and air-gapped environments.

The role sits at the intersection of DevOps, MLOps, FinOps, and observability, requiring strong GPU inference experience and multi-tenant cost optimization. A hybrid, flexible environment is offered by EY.