AI Systems Engineer: DevOps for AI Workloads

EY; Jacksonville (FL); Hybrid; USD 126,000 - 230,000; Full time

Benefits offered by this job

Medical and dental coverage

401(k) plan

Paid time off

Job summary

EY is seeking an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of EY’s AI-native platform. You will manage CI/CD/CV pipelines, secure model execution, and cost-aware, auditable AI workloads across cloud, on‑prem, and edge environments.

You’ll own governance for AI assets, cost attribution, and the full observability stack, collaborating with platform, trust, and data teams to ensure compliant, repeatable deployments at scale.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related field.
• 8+ years in DevOps, MLOps, platform, or observability with production ownership.
• Hands-on CI/CD/CV pipelines and GitOps tooling experience.
• In-depth knowledge of Ray Serve, vLLM, Triton or NIM on GPU infra.
• Proficient with Prometheus, Grafana, Loki, Tempo/Jaeger and OpenTelemetry.
• Experience with API gateways (Envoy) and request routing.
• Familiarity with cost tooling (OpenCost, Kubecost) and quota enforcement.

Responsibilities

• Own DevOps and delivery for AI workloads, building CI/CD/CV pipelines for AI services.
• Own governance and discovery for AI assets and model metadata.
• Own resource and cost management with per-tenant attribution.
• Own the full observability stack: metrics, logs, traces, dashboards.
• Own OpenTelemetry collection layer and GPU telemetry integration.
• Automate GitOps-based delivery and embedded quality gates.
• Drive deployment decisions with telemetry and automated rollbacks.
• Ensure cost/telemetry are identity-stamped and per-tenant.

Skills

CI/CD pipelines

GitOps tooling

OpenTelemetry

GPU inference

Cost attribution

Regulatory compliance

Education

Bachelor’s or Master’s degree in Computer Science or related field

Tools

Ray Serve

vLLM

Triton

NIM

Prometheus

Grafana

Loki

Tempo

Jaeger

Envoy

Harbor

MLflow

Trivy

OpenLineage

Job description

EY is seeking an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of EY’s AI-native platform. You will manage CI/CD/CV pipelines, secure model execution, and cost-aware, auditable AI workloads across cloud, on‑prem, and edge environments.

You’ll own governance for AI assets, cost attribution, and the full observability stack, collaborating with platform, trust, and data teams to ensure compliant, repeatable deployments at scale.