AI Platform Engineer: End-to-End AI Delivery & Observability

EY; City of Albany (NY); On-site; USD 126,000 - 230,000; Full time

Benefits offered by this job

Medical and dental coverage

401(k) and pension

Paid time off

Hybrid work model

Job summary

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability for EY’s AI-native platform across cloud, on-prem, edge, and air-gapped environments. You will own CI/CD pipelines, governance, cost attribution, and the full observability stack to ensure economical and reliable AI workloads.

The role spans DevOps, MLOps, FinOps, and observability, requiring experience with GPUs, model-serving frameworks, and regulatory compliance.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related technical field.
• 8+ years in DevOps, MLOps, platform, or observability engineering with production ownership of AI/high-throughput services.
• Strong hands-on DevOps experience with CI/CD/CV pipelines and GitOps tooling (ArgoCD, Helm, GitHub Actions/GitLab CI).
• Hands-on expertise operating inference/model-serving frameworks (Ray Serve, vLLM, Triton, NIM) on GPU infrastructure.
• Observability stacks (Prometheus, Grafana, Loki, Tempo/Jaeger) and OpenTelemetry.
• Experience with API gateways and request routing (Envoy).
• Cost management/FinOps tooling (OpenCost, Kubecost) and quota enforcement.
• Model/artifact registries and supply-chain scanning (Harbor, MLflow, Trivy).
• Proven track record operating AI infrastructure under regulatory constraints.
• Ability to define ownership boundaries and consumption contracts.

Responsibilities

• Own DevOps and delivery for AI workloads: CI/CD/CV pipelines, release and rollback.
• Own governance and discovery for AI assets, including registries and metadata.
• Own resource and cost management with per-tenant attribution.
• Own the full observability stack: metrics, logs, traces, dashboards, and evaluation tools.
• Own the OpenTelemetry collection layer across multi-tenant environments.
• Automate GitOps-based delivery and embedding quality and cost gates in pipelines.
• Close the loop between delivery and observability with telemetry and cost signals.
• Ensure cost and telemetry are identity-stamped and per-tenant.

Skills

DevOps

MLOps

Observability

FinOps

Governance

Cross-Functional

Communication

Education

Bachelor’s or Master’s in CS

Tools

ArgoCD

Helm

GitHub Actions

GitLab CI

Ray Serve

vLLM

Triton

NIM

Prometheus

Grafana

Loki

Tempo/Jaeger

Job description

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability for EY’s AI-native platform across cloud, on-prem, edge, and air-gapped environments. You will own CI/CD pipelines, governance, cost attribution, and the full observability stack to ensure economical and reliable AI workloads.

The role spans DevOps, MLOps, FinOps, and observability, requiring experience with GPUs, model-serving frameworks, and regulatory compliance.