AI Systems Engineer & DevOps Observability Lead

EY; Baltimore (MD); Hybrid; USD 126,000 - 230,000; Full time

Benefits offered by this job

Hybrid work model

Medical and dental coverage

401(k) plan

Paid time off

Flexible vacation policy

Job summary

EY seeks an AI Systems Engineer to own AI workload delivery, model serving, routing, and observability across cloud, on-prem, edge, and air‑gapped environments. You’ll manage CI/CD/CV pipelines, governance for AI assets, cost attribution, and a comprehensive observability stack to keep workloads reliable and economical.

The role sits at the intersection of DevOps, MLOps, FinOps, and observability, requiring strong communication to explain runtime, cost, and telemetry tradeoffs to engineers and

Qualifications

• Bachelor’s or Master’s in CS or related field.
• 8+ years in DevOps, MLOps, platform, or observability with hands-on ownership.
• Hands-on DevOps experience with CI/CD/CV pipelines and GitOps tooling.
• Hands-on expertise with inference/model-serving frameworks on GPU infrastructure.
• Strong observability experience with Prometheus, Grafana, Loki, OpenTelemetry.
• Familiarity with model/artifact registries and supply-chain scanning.

Responsibilities

• Own DevOps and delivery for AI workloads: CI/CD/CV pipelines, automated build, test, release, and rollback.
• Own governance and discovery for AI assets (registries, model metadata, licenses).
• Own resource and cost management with quota and rate limits.
• Own full observability stack: metrics, logs, traces, dashboards.
• Own OpenTelemetry collection, multi-tenant routing and GPU telemetry.
• Automate GitOps-based delivery with quality, integrity, and cost gates.
• Drive deployment decisions using telemetry and cost signals for rollback as needed.
• Ensure cost/telemetry are per-tenant and SLA-oriented.

Skills

DevOps

MLOps

Observability

Cost management

GitOps

GPU inference

Communication

OpenTelemetry

Education

Bachelor’s or Master’s degree in Computer Science or related field

Tools

ArgoCD

Helm

GitHub Actions

GitLab CI

Job description

EY seeks an AI Systems Engineer to own AI workload delivery, model serving, routing, and observability across cloud, on-prem, edge, and air‑gapped environments. You’ll manage CI/CD/CV pipelines, governance for AI assets, cost attribution, and a comprehensive observability stack to keep workloads reliable and economical.

The role sits at the intersection of DevOps, MLOps, FinOps, and observability, requiring strong communication to explain runtime, cost, and telemetry tradeoffs to engineers and