AI Platform Delivery & Observability Engineer

EY; St. Louis (MO); Hybrid; USD 126,000 - 230,000; Full time

Benefits offered by this job

Hybrid work model

Total Rewards package

Generous vacation policy

Job summary

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability for EY’s AI-native platform. You will manage CI/CD pipelines, governance of AI assets, and cost visibility across cloud, on-prem, edge, and air-gapped environments.

The role sits at the intersection of DevOps, MLOps, FinOps, and observability, requiring deep expertise in GPUs, model servers, and OpenTelemetry. A hybrid work model is offered with exposure to diverse environments and stakeholder

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related technical field.
• 8+ years in DevOps, MLOps, platform, or observability engineering with production ownership of AI or high-throughput services.
• Hands-on DevOps experience with CI/CD/CV pipelines and GitOps tooling (ArgoCD, Helm, GitHub Actions/GitLab CI).
• Hands-on expertise operating inference/model-serving frameworks (Ray Serve, vLLM, Triton, or NIM) on GPU infrastructure.
• Strong experience with observability stacks (Prometheus, Grafana, Loki, Tempo/Jaeger) and OpenTelemetry.
• Experience with API gateways and request routing (Envoy), including streaming responses.
• Experience with cost management / FinOps tooling (OpenCost, Kubecost) and quota/rate-limit enforcement.
• Familiarity with model/artifact registries and supply-chain scanning (Harbor, MLflow, Trivy).
• Proven track record operating AI or service infrastructure under compliance, security, or regulatory constraints.

Responsibilities

• Own DevOps and delivery for AI workloads: CI/CD/CV pipelines shipping AI services and runtime components.
• Own governance and discovery for AI assets and model metadata.
• Own resource and cost management with quotas and cost attribution per tenant.
• Own full observability stack: metrics, logs, traces, dashboards, and LLM debugging tooling.
• Own OpenTelemetry collection layer with multi-tenant architecture and GPU telemetry support.
• Automate GitOps-based delivery and embedding quality, integrity, and cost gates into pipelines.
• Close loop between delivery and observability to drive deployment decisions and automated rollback.
• Ensure cost telemetry are identity-stamped and per-tenant for FinOps alignment.

Skills

CI/CD

GitOps

Observability

DevOps

Cost optimisation

Model-serving

GPU/ML infra

OpenTelemetry

Communication

Education

Bachelor’s or Master’s in CS or related

Tools

Ray Serve

vLLM

Triton

NIM

Prometheus

Grafana

Loki

Tempo/Jaeger

Envoy

Harbor/Mlflow/Trivy

Job description

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability for EY’s AI-native platform. You will manage CI/CD pipelines, governance of AI assets, and cost visibility across cloud, on-prem, edge, and air-gapped environments.

The role sits at the intersection of DevOps, MLOps, FinOps, and observability, requiring deep expertise in GPUs, model servers, and OpenTelemetry. A hybrid work model is offered with exposure to diverse environments and stakeholder