Senior AI Systems Engineer: DevOps & Observability

Ernst & Young Oman; Jefferson City (MO); Hybrid; USD 107,000 - 177,000; Full time

Benefits offered by this job

Hybrid work model

Job summary

EY seeks an AI Systems Engineer to own the delivery, model-serving, routing, and observability for its AI-native platform. The role spans CI/CD pipelines, governance, cost attribution, and fully observable workloads across cloud and on-prem environments.

You will work with GPUs, model servers, and secure execution in a collaborative, hybrid setup. The ideal candidate has deep DevOps/MLOps experience, strong observability skills, and a track record of compliant, scalable AI infrastructure.

Qualifications

• 8+ years in DevOps, MLOps, platform, or observability engineering with production ownership of AI or high-throughput services.
• Hands-on CI/CD/CV pipelines and GitOps tooling (ArgoCD, Helm, GitHub Actions/GitLab CI).
• Experience with inference/model-serving frameworks on GPUs (Ray Serve, vLLM, Triton, or NIM).
• Strong observability stacks (Prometheus, Grafana, Loki) and OpenTelemetry.
• Experience with API gateways and request routing (Envoy).
• Familiarity with cost management tools (OpenCost, Kubecost).
• Knowledge of model/artifact registries and supply-chain scanning (Harbor, MLflow, Trivy).
• Experience delivering AI or service infrastructure under regulatory constraints.

Responsibilities

• Build and operate CI/CD/CV pipelines and GitOps tooling for AI workloads.
• Own governance and discovery for AI assets and registries.
• Manage resource and cost attribution to keep AI execution economical.
• Own observability stack from metrics to dashboards and AI debugging tools.
• Oversee multi-tenant telemetry collection and routing for signals.
• Automate delivery with policy gates for releases by default.
• Close the loop between delivery and observability to guide deployments.

Skills

DevOps

MLOps

Observability

Cost optimization

Model governance

Multi-env rollout

OpenTelemetry

Education

Bachelor's degree in CS or related field

Tools

ArgoCD

Helm

GitHub Actions

GitLab CI

MLflow

Harbor

Trivy

OpenLineage

Kubecost

Apptio

Job description

EY seeks an AI Systems Engineer to own the delivery, model-serving, routing, and observability for its AI-native platform. The role spans CI/CD pipelines, governance, cost attribution, and fully observable workloads across cloud and on-prem environments.

You will work with GPUs, model servers, and secure execution in a collaborative, hybrid setup. The ideal candidate has deep DevOps/MLOps experience, strong observability skills, and a track record of compliant, scalable AI infrastructure.