AI Systems Engineer: DevOps, Delivery & Observability

EY; Houston (TX); Hybrid; USD 107,000 - 177,000; Full time

Benefits offered by this job

Hybrid work model

Paid time off

Job summary

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability across cloud, on‑prem, edge, and air‑gapped environments. You will shape the runtime surface, CI/CD/CV pipelines, and governance for AI workloads with a focus on repeatable, economical execution.

The role sits at the intersection of DevOps, MLOps, FinOps, and observability, requiring strong GPU inference expertise, multi‑tenant cost attribution, and policy‑driven deployments.

Qualifications

• 8+ years in DevOps, MLOps, platform, or observability with hands-on ownership of AI/workloads.
• Hands-on CI/CD pipelines and GitOps tooling (ArgoCD, Helm, GitHub Actions/GitLab CI).
• Hands-on expertise operating inference/model-serving frameworks (Ray Serve, vLLM, Triton, NIM) on GPU.
• Strong observability experience with Prometheus, Grafana, Loki, Tempo/Jaeger and OpenTelemetry.
• Experience with API gateways and request routing (Envoy).
• Experience with cost management tools (OpenCost, Kubecost) and quota enforcement.
• Familiarity with model/artifact registries and supply-chain scanning (Harbor, MLflow, Trivy).
• Proven track record in compliant AI/service infrastructure delivery.

Responsibilities

• Own delivery and runtime surface for AI workloads across environments.
• Manage CI/CD/CV pipelines for AI services, including automated test and rollout.
• Oversee governance and discovery for AI assets and registries.
• Control cost attribution and utilization to keep AI workloads economical.
• Own observability stack: metrics, logs, traces, dashboards.
• Enforce policy gates in pipelines and enable automated rollbacks.
• Collaborate across platform, trust, and data teams on ownership boundaries.

Skills

DevOps for AI workloads

MLOps & observability

OpenTelemetry

GPU inference systems

Cost governance

Education

Bachelor's or Master's in CS or related

Tools

Ray Serve

vLLM

Triton

NIM

Prometheus

Grafana

OpenTelemetry

Kubecost

OpenCost

Envoy

Job description

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability across cloud, on‑prem, edge, and air‑gapped environments. You will shape the runtime surface, CI/CD/CV pipelines, and governance for AI workloads with a focus on repeatable, economical execution.

The role sits at the intersection of DevOps, MLOps, FinOps, and observability, requiring strong GPU inference expertise, multi‑tenant cost attribution, and policy‑driven deployments.