AI Platform DevOps & Observability Engineer

EY; Atlanta (GA); Hybrid; USD 126,000 - 230,000; Full time

Benefits offered by this job

Hybrid work model

Medical and dental coverage

Pension and 401(k)

Paid time off

Flexible vacation policy

Job summary

EY seeks an AI Systems Engineer to own delivery, model-serving, routing, and observability for EY’s AI-native platform. You will manage CI/CD pipelines, governance of AI assets, cost attribution, and end-to-end telemetry across cloud, on-prem, edge, and air-gapped environments.

The role blends DevOps, MLOps, FinOps, and observability, requiring mastery of GPU inference, multi-environment runtimes, and secure, compliant delivery. EY offers a hybrid model and a comprehensive Total Rewards package.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related technical field.
• 8+ years in DevOps, MLOps, platform, or observability engineering with hands-on production ownership of AI or high-throughput services.
• Hands-on DevOps experience including CI/CD/CV pipelines and GitOps tooling for automated build, test, release, and rollback.
• Hands-on expertise operating inference/model-serving frameworks on GPU infrastructure.
• Strong observability stacks and OpenTelemetry experience.

Responsibilities

• Own DevOps and delivery for AI workloads: build and operate CI/CD/CV pipelines shipping AI services, agents, and runtime components.
• Own governance and discovery for AI assets, including registries and model metadata.
• Own resource and cost management with quotas and attribution to keep AI workloads economical.
• Own the full observability stack: metrics, logs, traces, dashboards, and model evaluation tooling.
• Automate GitOps-based delivery and quality gates to ensure policy-compliant releases.
• Drive deployment decisions using telemetry and cost signals for automated rollbacks.

Skills

DevOps

MLOps

Observability

GitOps

CI/CD

OpenTelemetry

GPU inference

Education

Bachelor’s or Master’s degree in Computer Science

Tools

ArgoCD

Helm

GitHub Actions

GitLab CI

Ray Serve

vLLM

Triton

NIM

Prometheus

Grafana

Loki

Tempo/Jaeger

OpenTelemetry

Kubecost

OpenCost

Harbor

MLflow

Trivy

Job description

EY seeks an AI Systems Engineer to own delivery, model-serving, routing, and observability for EY’s AI-native platform. You will manage CI/CD pipelines, governance of AI assets, cost attribution, and end-to-end telemetry across cloud, on-prem, edge, and air-gapped environments.

The role blends DevOps, MLOps, FinOps, and observability, requiring mastery of GPU inference, multi-environment runtimes, and secure, compliant delivery. EY offers a hybrid model and a comprehensive Total Rewards package.