AI Systems Engineer: DevOps, Observability, AI Delivery

EY; Raleigh (NC); Hybrid; USD 107,000 - 177,000; Full time

Benefits offered by this job

Hybrid work model

Medical and dental coverage

Pension and 401(k)

Paid time off options

Job summary

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability for its AI-native platform. You will work across cloud, on‑prem, edge, and air‑gapped environments, building automated pipelines and cost-aware runtimes while ensuring governance and traceability of AI workloads.

You will collaborate with senior engineers to test, deploy, and optimize capabilities, focusing on repeatable, economically bounded AI delivery with robust observability and security.

Qualifications

• 8+ years in DevOps, MLOps or observability engineering with production ownership of AI workloads.
• Hands-on CI/CD pipelines and GitOps tooling for automated build, test, release, and rollback.
• Experience with inference frameworks on GPU infrastructure (Ray Serve, vLLM, Triton, or NIM).
• Strong observability stack knowledge (Prometheus, Grafana, Loki, Tempo/Jaeger) and OpenTelemetry.
• Familiarity with model/artifact registries and supply-chain scanning.

Responsibilities

• Build and operate CI/CD/CV pipelines that ship AI services and runtime components.
• Own governance and discovery for AI assets and model metadata.
• Manage resource costs, quotas, and tenant-based cost attribution.
• Own the full observability stack and alerting for AI workloads.
• Automate GitOps delivery and embed quality and cost gates in pipelines.
• Drive deployment decisions with telemetry, evaluation, and automated rollback.
• Ensure identity stamping and per-tenant traceability of consumption.
• Coordinate with platform, trust, and data teams on ownership boundaries.

Skills

DevOps

MLOps

Observability

OpenTelemetry

Cost attribution

Model governance

Registry management

CI/CD

GitOps

GPU inference

Education

Bachelor's or Master’s degree in CS or related field

Tools

Ray Serve

vLLM

Triton

NIM

Prometheus

Grafana

Loki

Tempo

Jaeger

Envoy

MLflow

Trivy

Harbor

OpenLineage

Kubecost/OpenCost

LangSmith

Langfuse

OpenTelemetry

Job description

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability for its AI-native platform. You will work across cloud, on‑prem, edge, and air‑gapped environments, building automated pipelines and cost-aware runtimes while ensuring governance and traceability of AI workloads.

You will collaborate with senior engineers to test, deploy, and optimize capabilities, focusing on repeatable, economically bounded AI delivery with robust observability and security.