Remote AI Systems Engineer — DevOps & Observability

EY; City of Rochester (NY); Hybrid; USD 128,000 - 201,000; Full time

Benefits offered by this job

Hybrid work model

Medical and dental coverage

Pension and 401(k)

Paid time off

Job summary

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability for EY’s AI-native platform. You’ll build automated pipelines, ensure secure model execution, and govern assets across cloud, on-prem, edge, and air-gapped environments.

Ideal candidates combine DevOps, MLOps, and FinOps experience, with hands-on work on GPUs, inference servers, and multi-tenant telemetry. EY offers hybrid work, strong compensation, and broad growth opportunities.

Qualifications

• 8+ years in DevOps, MLOps, platform, or observability engineering with hands-on AI/workload ownership.

Responsibilities

• Supports DevOps and delivery for AI workloads: CI/CD/CV pipelines to ship AI services and runtimes.
• Own governance and discovery for AI assets and model metadata.
• Own cost management and per-tenant attribution for AI workloads.
• Own the full observability stack: metrics, logs, traces, dashboards.
• Own OpenTelemetry collection layer across multi-tenant environments.
• Automate GitOps-based delivery with integrated quality and cost gates.
• Close the loop between delivery and observability via telemetry and evaluation signals.
• Ensure consumption and telemetry are identity-stamped per tenant and workload.

Skills

CI/CD pipelines

GitOps tooling

GPU inference

OpenTelemetry

Cost attribution

Model governance

Cloud & on-prem

LLM evaluation tooling

Education

Bachelor’s degree in Computer Science

Tools

Ray Serve

vLLM

Triton

NIM

Harbor

MLflow

Trivy

Envoy

Job description

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability for EY’s AI-native platform. You’ll build automated pipelines, ensure secure model execution, and govern assets across cloud, on-prem, edge, and air-gapped environments.

Ideal candidates combine DevOps, MLOps, and FinOps experience, with hands-on work on GPUs, inference servers, and multi-tenant telemetry. EY offers hybrid work, strong compensation, and broad growth opportunities.