AI Systems Engineer & DevOps Observability Lead

EY; Buffalo (NY); Hybrid; USD 126,000 - 230,000; Full time

Benefits offered by this job

Medical and dental coverage

Pension and 401(k)

Paid time off

Job summary

EY is seeking an AI Systems Engineer to own delivery, model serving, routing, and observability for EY’s AI-native platform. You will manage CI/CD/CV pipelines, governance of AI assets, and cost-visibility across cloud, on-prem, edge, and air-gapped environments.

The role sits at the intersection of DevOps, MLOps, FinOps, and observability, requiring hands-on experience with GPU inference, OpenTelemetry, and multi-tenant cost control. Hybrid work model in the US.

Qualifications

• 8+ years in DevOps, MLOps or observability engineering with production ownership.
• Hands-on CI/CD/CV pipelines, GitOps tooling (ArgoCD/Helm/GitHub Actions).
• Experience operating AI/model-serving frameworks on GPUs in production.

Responsibilities

• Own delivery and governance for AI workloads and assets across environments.
• Build and operate CI/CD/CV pipelines for AI services and runtime components.
• Implement cost attribution, quotas, and telemetry across tenants.
• Define observability stack and alerting with OpenTelemetry and Grafana.

Skills

DevOps engineering

MLOps

Observability

FinOps

Multi-environment runtimes

OpenTelemetry

Education

Bachelor’s or Master’s in Computer Science

Tools

Artifactory/Nexus

Harbor

MLflow

Trivy/SBOM

OpenLineage

LangSmith

Langfuse

Prometheus

Grafana

Jaeger

Envoy

Kubecost/OpenCost

Job description

EY is seeking an AI Systems Engineer to own delivery, model serving, routing, and observability for EY’s AI-native platform. You will manage CI/CD/CV pipelines, governance of AI assets, and cost-visibility across cloud, on-prem, edge, and air-gapped environments.

The role sits at the intersection of DevOps, MLOps, FinOps, and observability, requiring hands-on experience with GPU inference, OpenTelemetry, and multi-tenant cost control. Hybrid work model in the US.