Remote AI Systems Engineer: DevOps & Observability

EY; Grand Rapids (MI); On-site; USD 107,000 - 177,000; Full time

Benefits offered by this job

Hybrid/Remote flexibility

Medical and dental coverage

401(k)/Pension plans

Generous time off

Job summary

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability for EY’s AI-native platform across cloud, on-prem, edge, and air-gapped environments.

You will own CI/CD/CV pipelines, governance of AI assets, cost attribution, and the full observability stack, collaborating with senior engineers to test and develop capabilities while ensuring compliant, repeatable AI workloads.

Qualifications

• 8+ years in DevOps, MLOps, platform, or observability engineering with production ownership of AI or high-throughput services.
• Hands-on DevOps experience with CI/CD/CV pipelines and GitOps tooling for automated build, test, release, and rollback.
• Hands-on expertise operating inference/model-serving frameworks on GPU infrastructure.
• Strong observability stack experience (Prometheus, Grafana, Loki, Tempo/Jaeger) and OpenTelemetry.
• Experience with API gateways and request routing, including streaming responses.
• Experience with FinOps tooling and quota/rate-limit enforcement.
• Familiarity with model/artifact registries and supply-chain scanning.
• Proven track record operating AI/service infrastructure under compliance and regulatory constraints.

Responsibilities

• Own the delivery and runtime surface for AI workloads, including CI/CD/CV pipelines and release tooling.
• Manage governance and discovery for AI assets and metadata across registries and licenses.
• Control resource cost, quotas, and attribution to keep AI execution bounded per tenant.
• Own the full observability stack: metrics, logs, traces, dashboards, and AI debugging tools.
• Lead OpenTelemetry collection, multi-tenant routing, and GPU telemetry integration.
• Automate GitOps-based delivery with policy gates and automated verification.
• Close the loop between delivery and observability to guide rollout and rollback decisions.
• Ensure identity-based cost telemetry and per-tenant SLA/alerting for FinOps alignment.

Skills

DevOps

MLOps

Observability

FinOps

Governance

Multi-Environment

Communication

OpenTelemetry

Education

Bachelor's degree in CS or related field

Tools

Ray Serve

vLLM

Triton

NIM

Prometheus

Grafana

Loki

Jaeger

Envoy

Job description

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability for EY’s AI-native platform across cloud, on-prem, edge, and air-gapped environments.

You will own CI/CD/CV pipelines, governance of AI assets, cost attribution, and the full observability stack, collaborating with senior engineers to test and develop capabilities while ensuring compliant, repeatable AI workloads.