AI Systems Engineer: DevOps, Observability & FinOps

EY; Jacksonville (FL); Hybrid; USD 107,000 - 177,000; Full time

Job summary

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability across EY’s hybrid AI platform. You will oversee CI/CD pipelines, governance of AI assets, and cost attribution while ensuring secure, scalable GPU-based inference.

This role sits at the intersection of DevOps, MLOps, FinOps, and observability. You will collaborate with cross-functional teams to optimize telemetry, SLAs, and governance contracts across cloud, on‑prem, edge, and air‑gapped

Qualifications

• 8+ years in DevOps, MLOps, platform, or observability engineering with hands‑on ownership of AI workloads.
• Hands‑on CI/CD/CV pipelines and GitOps tooling (ArgoCD, Helm, GitHub Actions/GitLab CI, or equivalents).
• Hands‑on expertise operating inference/model‑serving frameworks (Ray Serve, vLLM, Triton, or NIM) on GPU infrastructure.
• Strong experience with observability stacks (Prometheus, Grafana, Loki, Tempo/Jaeger) and OpenTelemetry.
• Experience with API gateways and request routing (Envoy or equivalent), including streaming responses.
• Experience with cost management / FinOps tooling (OpenCost, Kubecost, or equivalent) and quota/rate‑limit enforcement.
• Familiarity with model/artifact registries and supply‑chain scanning (Harbor, MLflow, Trivy/SBOM).
• Proven track record operating AI or service infrastructure under compliance and regulatory constraints.

Responsibilities

• Build and operate the CI/CD/CV pipelines that ship AI services and runtime components.
• Own governance and discovery for AI assets and model metadata.
• Manage resource usage, quotas, and cost attribution per tenant and engagement.
• Own the full observability stack: metrics, logs, traces, dashboards.
• Own OpenTelemetry collection with multi-tenant receivers and exporters.
• Automate GitOps delivery and embed quality, integrity, and cost gates.
• Tie delivery to observability for deployment decisions and automated rollbacks.
• Ensure per-tenant identity stamping for consumption and telemetry.

Skills

CI/CD pipelines

GitOps

GPU inference

OpenTelemetry

Cost optimization

Regulatory compliance

LangSmith/Langfuse

Sandboxed execution

Ray Serve/vLLM/Triton/NIM

Education

Bachelor’s or Master’s degree in Computer Science or related field

Tools

MLflow

Harbor

Trivy

OpenLineage

HuggingFace

OpenCost

Kubecost

Prometheus

Grafana

Loki

Tempo/Jaeger

Ray Serve

vLLM

Triton

NIM

Envoy

LangSmith

Langfuse

Job description

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability across EY’s hybrid AI platform. You will oversee CI/CD pipelines, governance of AI assets, and cost attribution while ensuring secure, scalable GPU-based inference.

This role sits at the intersection of DevOps, MLOps, FinOps, and observability. You will collaborate with cross-functional teams to optimize telemetry, SLAs, and governance contracts across cloud, on‑prem, edge, and air‑gapped