AI Platform Engineer: DevOps, Observability & Governance

Ernst & Young Oman; Topeka (KS); On-site; USD 107,000 - 177,000; Full time

Benefits offered by this job

Hybrid work model

Flexible vacation policy

Paid time off

Job summary

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability for an AI-native platform across cloud, on-prem, edge, and air-gapped environments. You’ll collaborate with senior engineers to test and develop capabilities in a hybrid multi-environment runtime.

This role blends DevOps, MLOps, FinOps, and observability, requiring deep expertise in GPU inference, automated delivery pipelines, and comprehensive telemetry.

Qualifications

• 8+ years in DevOps, MLOps, platform, or observability engineering with hands-on production ownership of AI or high-throughput services.
• Hands-on DevOps experience with CI/CD/CV pipelines and GitOps tooling (ArgoCD, Helm, GitHub Actions/GitLab CI) for automated build, test, release, and rollback.
• Hands-on expertise operating inference/model-serving frameworks on GPU infrastructure.
• Strong experience with observability stacks and OpenTelemetry.
• Experience with API gateways and request routing, including streaming responses.
• Experience with cost management tooling (OpenCost, Kubecost) and quota/rate-limit enforcement.
• Familiarity with model/artifact registries and supply-chain scanning.

Responsibilities

• Build and operate CI/CD/CV pipelines for AI workloads across environments.
• Own governance and discovery for AI assets and model metadata.
• Manage resource cost, quotas, and attribution per tenant/workload.
• Own the full observability stack: metrics, logs, traces, dashboards.
• Automate GitOps-based delivery and verification with policy gates.
• Drive deployment decisions with telemetry and cost signals for safe rollouts.
• Ensure end-to-end identity stamping for multi-tenant observability and FinOps.

Skills

CI/CD pipelines

GitOps tooling

Model-serving frameworks

OpenTelemetry

FinOps tooling

Registries and governance

GPU inference

Observability stacks

Education

Bachelor’s or Master’s in Computer Science

Tools

Harbor

MLflow

Trivy

OpenLineage

LangSmith

Langfuse

Prometheus

Grafana

Job description

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability for an AI-native platform across cloud, on-prem, edge, and air-gapped environments. You’ll collaborate with senior engineers to test and develop capabilities in a hybrid multi-environment runtime.

This role blends DevOps, MLOps, FinOps, and observability, requiring deep expertise in GPU inference, automated delivery pipelines, and comprehensive telemetry.