Senior AI DevOps & Observability Engineer

Ernst & Young Oman; Washington (District of Columbia); Hybrid; USD 107,000 - 177,000; Full time

Benefits offered by this job

Hybrid work model

Comprehensive compensation andBenefits

Generous PTO

Job summary

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability across a multi-environment platform. You will build and operate CI/CD pipelines, govern AI assets, manage costs, and maintain full observability across cloud, on-prem, edge, and air-gapped environments.

You will work at the intersection of DevOps, MLOps, FinOps, and observability, collaborating with senior engineers to ensure repeatable, auditable AI workloads delivered in a compliant, cost-aware

Qualifications

• 8+ years in DevOps, MLOps, platform, or observability engineering with production ownership of AI or high-throughput services.
• Hands-on experience with CI/CD/CV pipelines and GitOps tooling for automated build, test, release, and rollback.
• Experience with inference/model-serving frameworks on GPU infrastructure.
• Familiarity with model/artifact registries and supply-chain scanning.

Responsibilities

• Build and operate CI/CD/CV pipelines for AI services and runtime components, including automated build, test, verification, release, and rollback.
• Own governance and discovery for AI assets and registries (Harbor, MLflow, Trivy, OpenLineage).
• Manage cost attribution and quotas to keep AI execution economical per tenant and workload.
• Own the full observability stack (Prometheus, Grafana, Loki, Tempo/Jaeger) and OpenTelemetry.
• Automate GitOps-based delivery with quality and cost gates in pipelines.
• Drive deployment decisions with telemetry, evaluation, and cost signals for safe rollouts and rollbacks.
• Ensure per-tenant identity stamping for FinOps and observability.

Skills

DevOps

MLOps

OpenTelemetry

CI/CD

GitOps

GPU/Inference

Observability

Education

Bachelor’s or Master’s degree in Computer Science or related field

Tools

ArgoCD

Helm

GitHub Actions / GitLab CI

OpenTelemetry

Prometheus/Grafana

LangSmith/Langfuse

Job description

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability across a multi-environment platform. You will build and operate CI/CD pipelines, govern AI assets, manage costs, and maintain full observability across cloud, on-prem, edge, and air-gapped environments.

You will work at the intersection of DevOps, MLOps, FinOps, and observability, collaborating with senior engineers to ensure repeatable, auditable AI workloads delivered in a compliant, cost-aware