Remote AI Systems Engineer: DevOps & Observability

EY; Huntsville (AL); Hybrid; USD 107,000 - 177,000; Full time

Benefits offered by this job

Hybrid work model

Medical and dental coverage

401(k)

Job summary

EY in the United States is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability across EY’s AI platform. You will shape the runtime surface for AI workloads, collaborating with DevOps, MLOps, FinOps, and observability teams to keep deployments secure, auditable, and cost-aware across cloud, on‑prem, edge, and air‑gapped environments.

This role covers governance, telemetry, and cost visibility, CI/CD/CV pipelines, GitOps, and open‑source tooling.

Qualifications

• 8+ years in DevOps, MLOps, platform, or observability engineering with hands-on ownership of AI or high-throughput services.
• Hands-on DevOps experience with CI/CD/CV pipelines and GitOps tooling (ArgoCD, Helm, GitHub Actions/GitLab CI).
• Hands-on expertise operating inference/model-serving frameworks (Ray Serve, vLLM, Triton, or NIM) on GPU infrastructure.
• Strong observability experience (Prometheus, Grafana, Loki, Tempo/Jaeger) and OpenTelemetry.
• Experience with API gateways and request routing (Envoy), incl. streaming responses.
• Experience with cost management tools (OpenCost, Kubecost) and quota enforcement.
• Familiarity with model/artifact registries and supply-chain scanning (Harbor, MLflow, Trivy).
• Proven track record operating AI or service infrastructure under regulatory constraints.
• Ability to define ownership boundaries and consumption contracts with platform, trust, and data teams.

Responsibilities

• Supports DevOps and delivery for AI workloads: CI/CD/CV pipelines and rollback for environments.
• Own governance and discovery for AI assets, including registries and lineage.
• Own resource and cost management with quotas and per-tenant attribution.
• Own the full observability stack: metrics, logs, traces, dashboards, and evaluation tools.
• Own OpenTelemetry collection layer and multi-tenant telemetry routing.
• Automate GitOps-based delivery and verification with policy gates.
• Close the loop between delivery and observability to inform deployment decisions.
• Ensure telemetry and cost signals drive progressive rollout and rollback.

Skills

DevOps

CI/CD

GitOps

Observability

OpenTelemetry

FinOps

Cost attribution

Education

Bachelor's or Master’s degree in Computer Science or related technical field

Tools

Ray Serve

vLLM/Triton/NIM

Prometheus

Grafana

Loki

Tempo/Jaeger

Envoy

Harbor

MLflow

Trivy

OpenLineage

Kubecost/OpenCost

Job description

EY in the United States is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability across EY’s AI platform. You will shape the runtime surface for AI workloads, collaborating with DevOps, MLOps, FinOps, and observability teams to keep deployments secure, auditable, and cost-aware across cloud, on‑prem, edge, and air‑gapped environments.

This role covers governance, telemetry, and cost visibility, CI/CD/CV pipelines, GitOps, and open‑source tooling.