AI Systems Engineer — DevOps, Delivery & Observability

EY; Providence (RI); Hybrid; USD 107,000 - 177,000; Full time

Benefits offered by this job

Job summary

EY in the United States is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability of EY’s AI-native platform across cloud, on‑prem, edge, and air‑gapped environments.

You will work with senior engineers, build automated delivery pipelines, and ensure repeatable, cost-aware execution of AI workloads. This role sits at the intersection of DevOps, MLOps, FinOps, and observability, requiring strong communication with engineers, architects, and leadership.

Qualifications

• 8+ years in DevOps, MLOps, platform, or observability engineering with production ownership of AI workloads.
• Hands-on DevOps experience with CI/CD/CV pipelines and GitOps tooling (ArgoCD, Helm, GitHub Actions/GitLab CI).
• Hands-on expertise operating inference/model-serving frameworks on GPU infrastructure.
• Experience with observability stacks (Prometheus, Grafana, Loki, Tempo/Jaeger) and OpenTelemetry.
• Experience with API gateways and request routing (Envoy), including streaming responses.
• Cost management / FinOps tooling (OpenCost, Kubecost) and quota/rate-limit enforcement.
• Familiarity with model/artifact registries and supply-chain scanning.
• Proven track record operating AI or service infrastructure under compliance constraints.

Responsibilities

• Supports DevOps and delivery for AI workloads with CI/CD/CV pipelines.
• Own governance and discovery for AI assets and model metadata.
• Own resource and cost management with quotas and attribution.
• Own the full observability stack: metrics, logs, traces, dashboards.
• Own OpenTelemetry collection layer for multi-tenant telemetry.
• Automate GitOps-based delivery and verification with policy gates.
• Close loop between delivery and observability using telemetry and cost signals.
• Ensure cost and telemetry are per-tenant and auditable.

Skills

DevOps pipelines

Model serving at scale

Observability skills

FinOps mindset

Governance & registries

Multi-cloud infra

Communication

Education

Bachelor's or Master's in CS/related

Tools

Ray Serve

vLLM

Triton

NIM

Envoy

Prometheus

Grafana

Loki

Tempo/Jaeger

MLflow

Harbor

Trivy

Kubecost

OpenCost

Job description

EY in the United States is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability of EY’s AI-native platform across cloud, on‑prem, edge, and air‑gapped environments.

You will work with senior engineers, build automated delivery pipelines, and ensure repeatable, cost-aware execution of AI workloads. This role sits at the intersection of DevOps, MLOps, FinOps, and observability, requiring strong communication with engineers, architects, and leadership.