AI Platform Delivery & Observability Lead

EY; Richmond (VA); Ibrido; USD 126.000 - 230.000; Tempo pieno

Vantaggi offerti da questo lavoro

Hybrid work model

Total Rewards package with medical and

Dental coverage

Paid time off

Descrizione del lavoro

EY is seeking an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of EY’s AI-native platform. You will oversee CI/CD pipelines, governance of AI assets, cost attribution, and the end-to-end telemetry that ensures repeatable, compliant AI workloads across cloud, on-prem, edge, and air-gapped environments.

This role sits at the intersection of DevOps, MLOps, FinOps, and observability, requiring deep expertise in GPUs, model servers, and secure execution,

Competenze

• Bachelor’s or Master’s degree in Computer Science or related technical field.
• 8+ years in DevOps, MLOps, platform, or observability engineering with production ownership of AI/services.
• Hands-on DevOps experience with CI/CD/CV pipelines and GitOps tooling (ArgoCD, Helm, GitHub Actions/GitLab CI).
• Hands-on expertise operating inference/model-serving frameworks (Ray Serve, vLLM, Triton, NIM) on GPU infrastructure.
• Strong observability experience (Prometheus, Grafana, Loki) and OpenTelemetry.
• Experience with API gateways and request routing (Envoy) and streaming responses.
• Experience with cost management / FinOps tooling and quota/rate-limit enforcement.
• Familiarity with model/artifact registries and governance (Harbor, MLflow, Trivy).
• Proven track record operating AI/service infrastructure under compliance and security constraints.

Mansioni

• Own DevOps and delivery for AI workloads: CI/CD/CV pipelines, automated build/test/verification, and safe releases across environments.
• Own governance and discovery for AI assets, including registries, experiment tracking, and licensing management.
• Own resource and cost management, including quotas and attribution to tenants/workloads.
• Own the full observability stack: metrics, logs, traces, dashboards, and AI debugging tools.
• Own the OpenTelemetry collection layer and multi-tenant telemetry routing.
• Automate GitOps delivery and integrate quality and cost gates into pipelines.
• Close the loop between delivery and observability using telemetry and cost signals for deployment decisions.

Conoscenze

DevOps

CI/CD pipelines

GitOps

Observability

Model-serving / inference

Cost management / FinOps

OpenTelemetry

GPU inference

Formazione

Bachelor’s or Master’s in Computer Science or related field

Strumenti

ArgoCD

Helm

GitHub Actions

GitLab CI

Ray Serve

Triton

NIM

Descrizione del lavoro

EY is seeking an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of EY’s AI-native platform. You will oversee CI/CD pipelines, governance of AI assets, cost attribution, and the end-to-end telemetry that ensures repeatable, compliant AI workloads across cloud, on-prem, edge, and air-gapped environments.

This role sits at the intersection of DevOps, MLOps, FinOps, and observability, requiring deep expertise in GPUs, model servers, and secure execution,