AI Systems Engineer & DevOps Observability Lead

EY; Jericho (NY); Hybrid; USD 126,000 - 262,000; Full time

Benefits offered by this job

Hybrid work model

Medical and dental coverage

401(k) plan

Job summary

EY seeks an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of EY’s AI-native platform. You will build and run the CI/CD pipelines, secure model execution, and governance across cloud, on-prem, edge, and air-gapped environments.

You will drive end-to-end observability with Prometheus, Grafana, Loki, Tempo/Jaeger, and OpenTelemetry, ensuring economically bounded, traceable AI workloads across diverse environments.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related field.
• 8+ years in DevOps, MLOps, platform, or observability engineering with ownership of AI or high-throughput services.
• Hands-on DevOps experience: CI/CD/CV pipelines and GitOps tooling for automated build, test, release, and rollback.
• Hands-on expertise operating inference/model-serving frameworks on GPU infrastructure.
• Strong observability stacks and OpenTelemetry experience.
• Experience with API gateways and request routing, including streaming responses.
• Experience with cost management/FinOps tooling and quota/rate-limit enforcement.
• Familiarity with model/artifact registries and supply-chain scanning.

Responsibilities

• Own DevOps and delivery for AI workloads through CI/CD/CV pipelines and GitOps practices.
• Oversee governance and discovery for AI assets and registries.
• Manage resource and cost control to keep AI execution economical per tenant.
• Own the full observability stack including metrics, logs, traces and dashboards.
• Oversee OpenTelemetry collection for multi-tenant environments with reliable routing.
• Automate GitOps-based delivery and verification with quality, integrity, and cost gates.
• Link delivery with telemetry and cost signals to guide deployment decisions and rollbacks.
• Ensure identity-stamped cost telemetry per tenant and align with FinOps.

Skills

DevOps

MLOps

Observability

FinOps

Governance

OpenTelemetry

GPU Inference

Ray Serve/Triton/NIM

Education

Bachelor’s or Master’s degree in CS or related field

Tools

ArgoCD

Helm

GitHub Actions

GitLab CI

Ray Serve

vLLM/Triton/NIM

Envoy

Harbor/MLflow/Trivy

Job description

EY seeks an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of EY’s AI-native platform. You will build and run the CI/CD pipelines, secure model execution, and governance across cloud, on-prem, edge, and air-gapped environments.

You will drive end-to-end observability with Prometheus, Grafana, Loki, Tempo/Jaeger, and OpenTelemetry, ensuring economically bounded, traceable AI workloads across diverse environments.