AI Systems Engineer: DevOps, Observability & FinOps

EY; Atlanta (GA); Hybrid; USD 107,000 - 177,000; Full time

Benefits offered by this job

Hybrid work model

Medical and dental coverage

Pension and 401(k)

Paid time off

Job summary

EY invites an AI Systems Engineer to own delivery, model-serving, routing, and observability for EY’s AI-native platform across cloud, on‑prem, and edge. You will shape the runtime surface, CI/CD pipelines, and governance, working with senior engineers to test and evolve capabilities.

The role spans DevOps, MLOps, FinOps, and observability, requiring strong communication and cross‑functional collaboration. Hybrid model in the US is offered.

Qualifications

• 8+ years in DevOps, MLOps, platform, or observability with hands-on ownership of AI or high-throughput services.
• Hands-on DevOps experience with CI/CD/CV pipelines and GitOps tooling for automated delivery.
• Inference/model-serving frameworks on GPU infrastructure.
• Strong observability stack experience and OpenTelemetry.
• Experience with API gateways and request routing, including streaming responses.
• Cost management tooling and quota/rate-limit enforcement.
• Familiarity with model/artifact registries and supply-chain scanning.
• Proven track record in regulated environments.

Responsibilities

• Build and operate CI/CD/CV pipelines shipping AI services and runtimes.
• Own governance, discovery, and cost attribution for AI assets.
• Manage cost and telemetry with per-tenant guarantees.
• Oversee full observability stack: metrics, logs, traces, dashboards.
• Automate GitOps-based delivery and policy-driven gates.
• Drive deployment decisions with telemetry and evaluation signals.
• Ensure secure model execution and reproducible deliveries.

Skills

DevOps engineering

MLOps

Observability

FinOps

Governance & lineage

Multi‑environment delivery

Communication to leadership

Education

Bachelor or Master in CS or related

Tools

ArgoCD

Helm

GitHub Actions

GitLab CI

Ray Serve

vLLM

Triton

NIM

Prometheus

Grafana

Loki

Tempo/Jaeger

OpenTelemetry

Envoy

OpenCost/Kubecost

Harbor/MLflow/Trivy

Job description

EY invites an AI Systems Engineer to own delivery, model-serving, routing, and observability for EY’s AI-native platform across cloud, on‑prem, and edge. You will shape the runtime surface, CI/CD pipelines, and governance, working with senior engineers to test and evolve capabilities.

The role spans DevOps, MLOps, FinOps, and observability, requiring strong communication and cross‑functional collaboration. Hybrid model in the US is offered.