Hybrid AI Systems Engineer: DevOps & Observability

EY; Baltimore (MD); On-site; USD 107,000 - 177,000; Full time

Job summary

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability for EY’s AI-native platform. You’ll shape runtime surfaces across cloud, on‑prem, edge, and air‑gapped environments while advising on governance, cost visibility, and telemetry.

This hybrid, remote-friendly role emphasizes building automated delivery pipelines, operating high‑performance inference, and delivering end-to-end observability with strong FinOps discipline.

Qualifications

• 8+ years in DevOps, MLOps, platform, or observability engineering with hands-on production ownership of AI or high-throughput services.
• Hands-on DevOps experience, including CI/CD/CV pipelines and GitOps tooling for automated build, test, release, and rollback.
• Hands-on expertise operating inference/model-serving frameworks on GPU infrastructure.
• Strong observability experience with metrics, logs, traces and OpenTelemetry.
• Experience with API gateways and request routing (Envoy or equivalent).
• Familiarity with model/artifact registries and supply-chain scanning.

Responsibilities

• Supports DevOps and delivery for AI workloads: build and operate CI/CD/CV pipelines that ship AI services, agents, and runtime components.
• Own governance and discovery for AI assets, including registries and artifact tracking.
• Own cost attribution and utilization to keep AI execution economically bounded per tenant.
• Own the full observability stack: metrics, logs, traces, dashboards, and debugging tools.
• Manage OpenTelemetry collection and multi-tenant telemetry routing.
• Automate GitOps-based delivery with quality and cost gates.
• Close the loop between delivery and observability to drive deployments and rollbacks.
• Ensure identity stamping of cost and telemetry per tenant.

Skills

DevOps pipelines

Model-serving systems

Observability

FinOps cost visibility

Governance & registries

Multi-environment runtime

Communication skills

Education

Bachelor’s or Master’s in Computer Science or related field

Tools

Envoy

OpenTelemetry

Prometheus

Grafana

Loki

LangSmith

Langfuse

Harbor/MLflow/Trivy

Kubecost/OpenCost

OpenLineage

Job description

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability for EY’s AI-native platform. You’ll shape runtime surfaces across cloud, on‑prem, edge, and air‑gapped environments while advising on governance, cost visibility, and telemetry.

This hybrid, remote-friendly role emphasizes building automated delivery pipelines, operating high‑performance inference, and delivering end-to-end observability with strong FinOps discipline.