AI Systems Engineer & DevOps Observability Lead

EY; Louisville (KY); Hybrid; USD 126,000 - 262,000; Full time

Benefits offered by this job

Hybrid work model

Medical & dental coverage

401(k) and pension

Job summary

EY seeks an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of EY’s AI-native platform. You will manage CI/CD pipelines, secure model execution, and governance across cloud, on‑prem, edge, and air‑gapped environments.

We value experience with high‑performance GPUs, advanced observability, and FinOps tooling, plus the ability to communicate tradeoffs to engineers and leadership. EY offers a hybrid model and world‑class benefits.

Qualifications

• Bachelor's or Master's degree in Computer Science or related technical field.
• 8+ years in DevOps, MLOps, platform, or observability engineering with production ownership of AI or high-throughput services.
• Hands-on DevOps experience with CI/CD/CV pipelines and GitOps tooling for automated build, test, release, and rollback.
• Hands-on expertise operating inference/model-serving frameworks (Ray Serve, vLLM, Triton, or NIM) on GPU infrastructure.
• Strong observability stack experience (Prometheus, Grafana, Loki, Tempo/Jaeger) and OpenTelemetry.
• Experience with API gateways and request routing (Envoy) including streaming responses.
• Experience with cost management tools (OpenCost, Kubecost) and quota enforcement.
• Familiarity with model/artifact registries and supply-chain scanning.

Responsibilities

• Own DevOps and delivery for AI workloads with CI/CD/CV pipelines and automated release/rollback.
• Own governance and discovery for AI assets and registries; manage metadata, licenses, and lineage.
• Own resource and cost management with tenant-specific attribution.
• Own full observability stack: metrics, logs, traces, dashboards, and LLM debugging tools.
• Own OpenTelemetry collection layer across multi-tenant environments.
• Automate GitOps-based delivery and embed quality and cost gates into pipelines.
• Drive deployment decisions via telemetry and cost signals, enabling automated rollbacks.
• Ensure cost and telemetry are per-tenant and identity-stamped.

Skills

DevOps

MLOps

Observability

Cost optimization

Communication

GitOps

GPUs

OpenTelemetry

Education

Bachelor's or Master's in CS

Tools

ArgoCD

Helm

GitHub Actions

GitLab CI

Ray Serve

vLLM/Triton/NIM

Prometheus

Grafana

Loki

Tempo/Jaeger

OpenTelemetry

Harbor/MLflow

Trivy

Kubecost/OpenCost

Job description

EY seeks an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of EY’s AI-native platform. You will manage CI/CD pipelines, secure model execution, and governance across cloud, on‑prem, edge, and air‑gapped environments.

We value experience with high‑performance GPUs, advanced observability, and FinOps tooling, plus the ability to communicate tradeoffs to engineers and leadership. EY offers a hybrid model and world‑class benefits.