AI Systems Engineer: DevOps, Observability & Platform

EY; Miami (FL); Hybrid; USD 107,000 - 177,000; Full time

Benefits offered by this job

Hybrid work model

Medical & dental coverage

401(k) plan

Paid time off

Job summary

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability for EY’s AI-native platform. You will integrate CI/CD/CV pipelines, secure model execution, and governance across cloud, on-prem, edge, and air-gapped environments.

The role blends DevOps, MLOps, FinOps, and observability, requiring deep expertise in GPU inference, telemetry, and cost-aware delivery. This hybrid role offers a flexible, globally connected work model within EY’s inclusive culture.

Qualifications

• 8+ years in DevOps, MLOps, platform, or observability engineering with hands-on ownership of AI or high-throughput services.
• Hands-on DevOps experience with CI/CD/CV pipelines and GitOps tooling (ArgoCD, Helm, GitHub Actions/GitLab CI) for automated build, test, release, and rollback.
• Hands-on expertise operating inference/model-serving frameworks (Ray Serve, vLLM, Triton, or NIM) on GPU infrastructure.
• Strong observability stacks (Prometheus, Grafana, Loki, Tempo/Jaeger) and OpenTelemetry.
• Experience with API gateways and request routing (Envoy) including streaming responses.
• Experience with FinOps tooling (OpenCost, Kubecost) and quota/rate-limit enforcement.
• Familiarity with model/artifact registries and supply-chain scanning (Harbor, MLflow, Trivy/SBOM).
• Proven track record operating AI or service infrastructure under compliance and regulatory constraints.
• Ability to define clean ownership boundaries and consumption contracts.

Responsibilities

• Supports DevOps and delivery for AI workloads: build and operate CI/CD/CV pipelines that ship AI services, agents, and runtime components, including automated build, test, verification, release, and rollback.
• Own governance and discovery for AI assets, including service catalog/registry and model metadata.
• Own resource and cost management, including quotas and rate limits, cost attribution and utilization.
• Own the full observability stack: metrics, logs, traces, dashboards, and AI debugging/evaluation tools.
• Own the OpenTelemetry collection layer and multi-tenant receiver/exporters.
• Automate GitOps-based delivery and continuous verification with policy gates.
• Close the loop between delivery and observability using telemetry and cost signals for deployment decisions.
• Ensure cost and telemetry are per-tenant and attributable.

Skills

CI/CD pipelines

GitOps

ArgoCD

Helm

GitHub Actions

GitLab CI

OpenTelemetry

Observability

Cost optimization

Education

Bachelor's or Master’s degree in Computer Science or related field

Tools

Ray Serve

vLLM

Triton

NIM

Prometheus

Grafana

Loki

Tempo/Jaeger

LangSmith

Langfuse

Job description

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability for EY’s AI-native platform. You will integrate CI/CD/CV pipelines, secure model execution, and governance across cloud, on-prem, edge, and air-gapped environments.

The role blends DevOps, MLOps, FinOps, and observability, requiring deep expertise in GPU inference, telemetry, and cost-aware delivery. This hybrid role offers a flexible, globally connected work model within EY’s inclusive culture.