AI Systems Engineer & DevOps Observability Lead

EY; Houston (TX); Hybrid; USD 126,000 - 230,000; Full time

Job summary

EY is hiring an AI Systems Engineer to own delivery, model serving, routing, and observability for EY’s AI-native platform. The role spans CI/CD, governance, cost attribution, and multi‑environment observability across cloud, on‑prem, edge, and air-gapped environments.

The ideal candidate combines DevOps, MLOps, FinOps, and observability expertise with experience in GPU inference and secured execution, delivering repeatable, economical AI workloads at scale.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related field.
• 8+ years in DevOps, MLOps, platform, or observability engineering with hands‑on ownership of AI or high‑throughput services.
• Strong hands‑on DevOps experience, including CI/CD/CV pipelines and GitOps tooling.
• Hands‑on expertise operating inference/model‑serving frameworks on GPU infrastructure.
• Strong observability experience with Prometheus, Grafana, Loki, Tempo/Jaeger and OpenTelemetry.
• Experience with API gateways and request routing (Envoy) and streaming responses.

Responsibilities

• Own DevOps and delivery for AI workloads and CI/CD/CV pipelines for ships AI services, runtimes, and governance components.
• Own governance and discovery for AI assets, including registries, model metadata, and licenses.
• Own resource and cost management, including quotas and cost attribution to keep AI execution economical per tenant.
• Own the full observability stack: metrics, logs, traces, dashboards, and evaluation tooling.
• Own the OpenTelemetry collection layer for multi‑tenant telemetry and reliable signal routing.
• Automate GitOps‑based delivery and embed quality, integrity, and cost gates into pipelines.
• Close the loop between delivery and observability to drive deployment decisions and automated rollback.
• Ensure per‑tenant identity stamping of cost and telemetry to tie workloads to FinOps signals.

Skills

DevOps

Observability

FinOps

Communication

Education

BSc/MSc in CS

Tools

Ray Serve

vLLM

Triton

NIM

Envoy

Job description

EY is hiring an AI Systems Engineer to own delivery, model serving, routing, and observability for EY’s AI-native platform. The role spans CI/CD, governance, cost attribution, and multi‑environment observability across cloud, on‑prem, edge, and air-gapped environments.

The ideal candidate combines DevOps, MLOps, FinOps, and observability expertise with experience in GPU inference and secured execution, delivering repeatable, economical AI workloads at scale.