AI Platform DevOps & Observability Engineer

EY; City of Rochester (NY); Híbrido; USD 126.000 - 262.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Hybrid work model

Total Rewards package (medical/dental,

Pension & 401(k) and paid time off

Descripción de la vacante

EY seeks an AI Systems Engineer to own delivery, model serving, routing, and observability for its AI-native platform. You will handle CI/CD pipelines, cost governance, and end-to-end delivery across cloud, on-prem, and edge environments.

The role combines DevOps, MLOps, FinOps, and observability, requiring hands-on experience with GPU inference, model-serving stacks, and OpenTelemetry. EY offers a hybrid work model and a comprehensive benefits package.

Formación

• Bachelor’s or Master’s degree in Computer Science or related technical field.
• 8+ years in DevOps, MLOps, platform, or observability engineering with production ownership of AI workloads.
• Hands-on DevOps experience with CI/CD and GitOps tooling for automated build, test, release, rollback.
• Hands-on expertise operating inference/model-serving frameworks on GPU infrastructure.
• Strong observability experience with Prometheus, Grafana, Loki, Tempo/Jaeger.
• Familiarity with model/artifact registries and supply-chain scanning.
• Experience with API gateways and request routing.

Responsabilidades

• Own DevOps and delivery for AI workloads: CI/CD pipelines, automated build, test, and release.
• Own governance and discovery for AI assets and registries.
• Own cost management and resource quotas to keep AI execution bounded.
• Own the full observability stack: metrics, logs, traces, dashboards.
• Own OpenTelemetry collection, including multi-tenant receivers and GPUs telemetry.
• Automate GitOps-based delivery and verification with policy gates.
• Close the loop between delivery and observability to drive decisions and rollbacks.
• Ensure per-tenant cost attribution and observability alignment with workloads.

Conocimientos

DevOps

Model serving

Observability

FinOps

OpenTelemetry

Governance

Educación

BSc/MSc in Computer Science

Herramientas

Ray Serve

vLLM

Triton

NIM

Descripción del empleo

EY seeks an AI Systems Engineer to own delivery, model serving, routing, and observability for its AI-native platform. You will handle CI/CD pipelines, cost governance, and end-to-end delivery across cloud, on-prem, and edge environments.

The role combines DevOps, MLOps, FinOps, and observability, requiring hands-on experience with GPU inference, model-serving stacks, and OpenTelemetry. EY offers a hybrid work model and a comprehensive benefits package.