Remote AI Systems Engineer & DevOps — Observability & FinOps

EY; Huntsville (AL); Hybrid; USD 126,000 - 230,000; Full time

Benefits offered by this job

Medical and dental coverage

Pension and 401(k)

Paid time off

Job summary

EY is seeking an AI Systems Engineer to own delivery, model-serving, and observability for EY’s AI-native platform. You will manage CI/CD/CV pipelines, governance of AI assets, and cost attribution across on‑prem, cloud, and edge environments.

The role requires experience with GPU inference, multi-tenant cost controls, and OpenTelemetry-based monitoring. EY offers hybrid work, extensive benefits, and a focus on responsible AI delivery.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related technical field.
• 8+ years in DevOps, MLOps, platform, or observability engineering with hands-on ownership of AI or high-throughput services.
• Hands-on DevOps experience including CI/CD/CV pipelines and GitOps tooling for automated build, test, release, and rollback.
• Hands-on expertise operating inference/model-serving frameworks on GPU infrastructure.
• Strong observability experience with Prometheus, Grafana, Loki, Tempo/Jaeger and OpenTelemetry.

Responsibilities

• Own DevOps and delivery for AI workloads, building and operating CI/CD/CV pipelines for AI services and runtimes.
• Own governance and discovery for AI assets, including registries, model metadata, and license management.
• Own resource and cost management with quotas and rate limits to keep AI execution bounded.
• Own the full observability stack (metrics, logs, traces, dashboards) and SLA/alerting.
• Own OpenTelemetry collection layer across multi-tenant environments.
• Automate GitOps-based delivery and verification with policy gates.
• Close the loop between delivery and observability using telemetry and cost signals to drive deployment decisions.
• Ensure per-tenant cost attribution and telemetry binding to workloads.

Skills

DevOps

Observability

FinOps

Governance

Communication

Education

Bachelor’s or Master’s in Computer Science

Tools

Prometheus

Grafana

OpenTelemetry

Envoy

Harbor

MLflow

Trivy

Kubecost

LangSmith/Langfuse

Job description

EY is seeking an AI Systems Engineer to own delivery, model-serving, and observability for EY’s AI-native platform. You will manage CI/CD/CV pipelines, governance of AI assets, and cost attribution across on‑prem, cloud, and edge environments.

The role requires experience with GPU inference, multi-tenant cost controls, and OpenTelemetry-based monitoring. EY offers hybrid work, extensive benefits, and a focus on responsible AI delivery.