AI Platform Delivery & Observability Engineer

EY; Salem (OR); Hybrid; USD 126,000 - 230,000; Full time

Benefits offered by this job

Medical and dental coverage

Pension/401(k)

Paid time off

Job summary

EY seeks an AI Systems Engineer to own delivery, model-serving, routing, and observability across EY’s AI-native platform. You will oversee CI/CD pipelines, governance of AI assets, cost attribution, and end-to-end telemetry in cloud, on-prem, edge, and air-gapped environments.

The role combines DevOps, MLOps, FinOps, and observability, requiring expertise in GPU inference, multi-environment runtimes, and policy-driven releases with strong cross-team collaboration.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related technical field.
• 8+ years in DevOps, MLOps, platform, or observability engineering with hands-on AI/workloads ownership.
• Hands-on DevOps experience including CI/CD/CV pipelines and GitOps tooling for automated build, test, release, and rollback.
• Hands-on expertise operating inference/model-serving frameworks on GPU infrastructure.
• Strong observability experience with metrics, logs, traces, and OpenTelemetry.
• Experience with API gateways and request routing (Envoy) including streaming.
• Experience with cost management/FinOps tooling and quota/rate-limit enforcement.
• Familiarity with model/artifact registries and supply-chain scanning.
• Proven track record operating AI/service infrastructure under compliance constraints.
• Ability to define clean ownership boundaries and contracts with platform/trust/data teams.

Responsibilities

• Own DevOps and delivery for AI workloads: CI/CD/CV pipelines and rollout.
• Own governance and discovery for AI assets including registries and model metadata.
• Own resource and cost management with quotas and attribution.
• Own the full observability stack: metrics, logs, traces, dashboards.
• Own OpenTelemetry collection layer and telemetry routing.
• Automate GitOps delivery and enforce policy-based verification.
• Close the loop between delivery and observability using signals for deployment decisions.
• Ensure per-tenant cost attribution and SLA/alerting across workloads.

Skills

DevOps/CI-CD

MLOps

Observability

FinOps

OpenTelemetry

Model serving

Regulatory/compliance

Cross-functional communication

Education

Bachelor’s or Master’s degree in CS or related field

Tools

ArgoCD

Helm

GitHub Actions/GitLab CI

Ray Serve/vLLM/Triton/NIM

Prometheus/Grafana/Loki/Tempo/Jaeger/OpenTelemetry

Envoy

Harbor/MLflow/Trivy/OpenLineage

Kubecost/OpenCost

Job description

EY seeks an AI Systems Engineer to own delivery, model-serving, routing, and observability across EY’s AI-native platform. You will oversee CI/CD pipelines, governance of AI assets, cost attribution, and end-to-end telemetry in cloud, on-prem, edge, and air-gapped environments.

The role combines DevOps, MLOps, FinOps, and observability, requiring expertise in GPU inference, multi-environment runtimes, and policy-driven releases with strong cross-team collaboration.