Senior AI Platform DevOps & Observability Engineer

EY; City of Rochester (NY); Remoto; USD 107.000 - 201.000; Tempo pieno

Descrizione del lavoro

EY is seeking an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of EY’s AI-native platform. This role sits at the intersection of DevOps, MLOps, FinOps and observability, spanning cloud, on-prem, edge, and air-gapped environments.

The ideal candidate will build automated delivery pipelines, operate high-performance inference, and implement comprehensive telemetry and cost visibility for repeatable, compliant AI workloads.

Competenze

• 8+ years in DevOps, MLOps, platform, or observability engineering with hands-on production ownership of AI or high-throughput services.
• Hands-on DevOps experience, including CI/CD/CV pipelines and GitOps tooling (ArgoCD, Helm, GitHub Actions/GitLab CI, or equivalents).
• Hands-on expertise operating inference/model-serving frameworks (Ray Serve, vLLM, Triton, or NIM) on GPU infrastructure.
• Strong experience with observability stacks (Prometheus, Grafana, Loki, Tempo/Jaeger) and OpenTelemetry.
• Experience with API gateways and request routing (Envoy or equivalent), including streaming responses.
• Experience with cost management / FinOps tooling (OpenCost, Kubecost, or equivalent) and quota/rate-limit enforcement.
• Familiarity with model/artifact registries and supply-chain scanning (Harbor, MLflow, Trivy/SBOM).
• Proven track record operating AI or service infrastructure under compliance, security, or regulatory constraints.

Mansioni

• Supports DevOps and delivery for AI workloads: build and operate CI/CD/CV pipelines that ship AI services, agents, and runtime components, including automated build, test, verification, release, and rollback.
• Own governance and discovery for AI assets, including service catalog/registry, experiment tracking and model metadata, upstream registries/mirrors, SBOM scanning, lineage contracts, and license management.
• Own resource and cost management, including quotas and rate limits, cost attribution and utilization to keep AI execution bounded.
• Own the full observability stack, including metrics, logs, traces, dashboards, and model debugging/evaluation tooling.
• Own the OpenTelemetry collection layer, including multi-tenant receivers, exporters and queues, and GPU telemetry.
• Automate GitOps-based delivery and continuous verification with policy gates embedded in pipelines.
• Close the loop between delivery and observability using telemetry and cost signals to drive deployment decisions and automated rollback.
• Ensure cost and telemetry are identity-stamped and per-tenant.

Conoscenze

DevOps

MLOps

Observability

FinOps

Governance

Cloud/On-Prem

GPU Inference

OpenTelemetry

CI/CD

Communication

Formazione

Bachelor's degree in Computer Science

Strumenti

Ray Serve

vLLM

Triton

LangSmith

Langfuse

Descrizione del lavoro

EY is seeking an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of EY’s AI-native platform. This role sits at the intersection of DevOps, MLOps, FinOps and observability, spanning cloud, on-prem, edge, and air-gapped environments.

The ideal candidate will build automated delivery pipelines, operate high-performance inference, and implement comprehensive telemetry and cost visibility for repeatable, compliant AI workloads.