AI Platform DevOps & Observability Engineer

EY; City of Albany (NY); Hybrid; USD 107,000 - 177,000; Full time

Benefits offered by this job

Hybrid work model

Total Rewards package

Medical & dental coverage

Job summary

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability across EY’s AI-native platform. You will shape how AI workloads are built, executed, and observed from cloud to on‑prem, ensuring repeatable, auditable delivery in a regulated environment.

This role sits at the intersection of DevOps, MLOps, FinOps, and observability, requiring strong expertise in CI/CD, GPU inference, and multi‑environment telemetry.

Qualifications

• 8+ years in DevOps, MLOps, platform, or observability with hands-on AI workloads.
• Hands-on CI/CD pipelines and GitOps tooling for automated build, test, release, and rollback.
• Experience operating inference/model-serving frameworks (Ray Serve, vLLM, Triton, or NIM) on GPU infrastructure.
• Strong observability with Prometheus/Grafana/OpenTelemetry.
• Experience with registries, CVE scanning, and license/lineage tracking.
• Comfort across cloud, on‑prem, edge, and air‑gapped environments.

Responsibilities

• Supports DevOps and delivery for AI workloads: CI/CD/CV pipelines, automated build, test, continuous verification, release, and rollback.
• Own governance and discovery for AI assets, including service catalog/registry and model metadata.
• Own resource and cost management, including quotas and rate limits, cost attribution and utilization.
• Own the full observability stack, including metrics, logs, traces, dashboards, and LangSmith/Langfuse for evaluation.
• Own the OpenTelemetry collection layer, including multi‑tenant receiver and Kafka export.
• Automate GitOps-based delivery and continuous verification with policy gates by default.
• Close the loop between delivery and observability using telemetry and cost signals for deployment decisions.
• Ensure cost and telemetry are identity‑stamped and per‑tenant.

Skills

DevOps & GitOps

MLOps

Observability

Cost optimization

AI model serving

Cloud & on-prem

Education

Bachelors or Masters in CS

Tools

Ray Serve

vLLM

Triton

NIM

Job description

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability across EY’s AI-native platform. You will shape how AI workloads are built, executed, and observed from cloud to on‑prem, ensuring repeatable, auditable delivery in a regulated environment.

This role sits at the intersection of DevOps, MLOps, FinOps, and observability, requiring strong expertise in CI/CD, GPU inference, and multi‑environment telemetry.