Senior AI Systems Engineer - DevOps, Observability

Ernst & Young Oman; Charleston (WV); Remote; USD 107,000 - 177,000; Full time

Benefits offered by this job

Hybrid work model

Medical and dental coverage

401(k)

Job summary

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability for EY's AI-native platform. You will shape the end-to-end runtime including CI/CD pipelines, secure model execution, and cost-aware telemetry across cloud, on-prem, and edge environments.

This role sits at the intersection of DevOps, MLOps, FinOps, and observability, requiring hands-on experience with production-grade AI workloads, GPU inference, and multi-tenant governance.

Qualifications

• 8+ years in DevOps, MLOps, platform, or observability with hands-on ownership of AI or high-throughput services.
• Hands-on CI/CD/CV pipelines and GitOps tooling for automated build, test, release, and rollback.

Responsibilities

• Build and operate CI/CD/CV pipelines that ship AI services and runtime components.
• Own governance and discovery for AI assets and model metadata (MLflow) and registries (Harbor, Nexus).
• Manage resource/cost attribution and quotas to keep AI execution economical.

Skills

DevOps

MLOps

Observability

OpenTelemetry

GitOps

CI/CD

GPU inference

Model serving

Cost management

Artifacts governance

Education

Bachelor's/Master's in CS

Tools

Ray Serve

vLLM

Triton

NIM

Prometheus

Grafana

Loki

Tempo

Jaeger

OpenTelemetry

Harbor

MLflow

Trivy

OpenLineage

Job description

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability for EY's AI-native platform. You will shape the end-to-end runtime including CI/CD pipelines, secure model execution, and cost-aware telemetry across cloud, on-prem, and edge environments.

This role sits at the intersection of DevOps, MLOps, FinOps, and observability, requiring hands-on experience with production-grade AI workloads, GPU inference, and multi-tenant governance.