AI Systems Engineer: DevOps, Observability & FinOps

EY; Austin (TX); On-site; USD 107,000 - 177,000; Full time

Job summary

EY is seeking an AI Systems Engineer to own the delivery, model-serving, and observability layer of EY’s AI-native platform. You will oversee CI/CD/CV pipelines, secure model execution, governance of AI assets, and cost attribution across cloud and on-prem environments.

The role sits at the intersection of DevOps, MLOps, FinOps, and observability, requiring strong skills in OpenTelemetry, multi-tenant cost management, and GPU-accelerated inference.

Qualifications

• 8+ years in DevOps, MLOps, platform, or observability engineering with production ownership of AI workloads.
• Hands-on with CI/CD/CV pipelines and GitOps tooling (ArgoCD, Helm, GitHub Actions/GitLab CI).
• Experience operating AI/model-serving frameworks (Ray Serve, vLLM, Triton, NIM) on GPU infra.
• Strong observability stack experience (Prometheus, Grafana, Loki, Tempo/Jaeger) and OpenTelemetry.
• Familiarity with API gateways (Envoy) and streaming API capabilities.
• Cost management tooling (OpenCost, Kubecost) and quota/rate-limit enforcement.
• Knowledge of model registries, governance, scanning (Harbor, MLflow, Trivy/SBOM).
• Proven track record delivering AI/service infrastructure under regulated constraints.

Responsibilities

• Own delivery and runtime surface for AI workloads, including CI/CD/CV pipelines and secure model execution.
• Manage governance for AI assets, registries, metadata, and license management.
• Oversee cost attribution and utilization to keep AI execution within bounds per tenant.
• Own full observability stack: metrics, logs, traces, dashboards, and SLA/alerts.
• Lead OpenTelemetry collection and multi-tenant signal routing for reliable telemetry.
• Automate GitOps-based delivery with quality and cost gates in pipelines.
• Bridge delivery and observability with telemetry data to drive rollout and rollback decisions.
• Ensure end-to-end ownership boundaries across platform, trust, and data teams.

Skills

CI/CD pipelines

GitOps

Observability

FinOps mindset

Multi-environment latency

OpenTelemetry

Repo governance

Cross-functional

Education

Bachelor’s or Master’s degree in Computer Science or related field

Tools

Ray Serve

vLLM

Triton

NIM

Prometheus

Grafana

OpenTelemetry

Envoy

Job description

EY is seeking an AI Systems Engineer to own the delivery, model-serving, and observability layer of EY’s AI-native platform. You will oversee CI/CD/CV pipelines, secure model execution, governance of AI assets, and cost attribution across cloud and on-prem environments.

The role sits at the intersection of DevOps, MLOps, FinOps, and observability, requiring strong skills in OpenTelemetry, multi-tenant cost management, and GPU-accelerated inference.