AI Systems Engineer - DevOps, Observability & Delivery

Ernst & Young Oman; Jericho (NY); Hybrid; USD 107,000 - 177,000; Full time

Job summary

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability for its AI-native platform. This role sits at the intersection of DevOps, MLOps, FinOps, and observability across cloud, on-prem, edge, and air-gapped environments.

Ideal candidates will have hands-on experience with GPU inference, automated delivery pipelines, and governance of AI assets, with strong communication skills to explain trade-offs to engineers and leadership.

Qualifications

• 8+ years in DevOps, MLOps, platform, or observability engineering, with hands-on production ownership of AI or high-throughput services.

Responsibilities

• Supports DevOps and delivery for AI workloads: build and operate CI/CD/CV pipelines that ship AI services and runtime components.

Skills

DevOps

MLOps

Observability

GitOps tooling

AI workloads

Cost governance

Education

Bachelor’s or Master’s degree in Computer Science or related technical field

Tools

ArgoCD

Helm

GitHub Actions

GitLab CI

Ray Serve

vLLM / Triton / NIM

LangSmith / Langfuse

Prometheus / Grafana

OpenTelemetry

Kubecost / OpenCost

Harbor / MLflow / Trivy

Job description

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability for its AI-native platform. This role sits at the intersection of DevOps, MLOps, FinOps, and observability across cloud, on-prem, edge, and air-gapped environments.

Ideal candidates will have hands-on experience with GPU inference, automated delivery pipelines, and governance of AI assets, with strong communication skills to explain trade-offs to engineers and leadership.