AI Systems Engineer & DevOps – End-to-End AI Delivery

EY; Stamford (CT); Hybrid; USD 126,000 - 230,000; Full time

Benefits offered by this job

Hybrid work model

Generous time off & holidays

Total Rewards package (medical/dental,

Job summary

EY is hiring an AI Systems Engineer to own delivery, model-serving, routing, and observability for EY's AI-native platform. You will integrate CI/CD/CV pipelines, secure model execution, and governance across cloud, on-prem, edge, and air-gapped environments.

You will work at the intersection of DevOps, MLOps, FinOps, and observability, delivering repeatable AI workloads with cost-conscious, traceable execution and strong telemetry across multi-tenant environments.

Qualifications

• 8+ years in DevOps, MLOps, platform, or observability engineering with hands-on production ownership of AI or high-throughput services.
• Hands-on experience with CI/CD/CV pipelines and GitOps tooling for automated build, test, release, and rollback.
• Experience operating inference/model-serving frameworks on GPU infrastructure.
• Strong observability stack experience and OpenTelemetry.

Responsibilities

• Own DevOps and delivery for AI workloads: pipelines to ship AI services, agents, and runtime components.
• Own governance and discovery for AI assets and model metadata.
• Own resource and cost management with quotas and attribution.
• Own the full observability stack: metrics, logs, traces, dashboards.
• Own the OpenTelemetry collection layer for multi-tenant environments.
• Automate GitOps-based delivery and continuous verification with policy gates.
• Close the loop between delivery and observability to drive deployment decisions.
• Ensure per-tenant cost attribution and telemetry alignment with workloads.

Skills

DevOps

Observability

FinOps

Governance

OpenTelemetry

Communication

Multi-environment

Education

Bachelor’s or Master’s degree in Computer Science

Tools

CI/CD pipelines

GitOps tooling

ArgoCD

Helm

GitHub Actions

GitLab CI

Ray Serve/VLLM/Triton

Prometheus/Grafana/Loki/Tempo/Jaeger

OpenLineage/Harbor/MLflow

Job description

EY is hiring an AI Systems Engineer to own delivery, model-serving, routing, and observability for EY's AI-native platform. You will integrate CI/CD/CV pipelines, secure model execution, and governance across cloud, on-prem, edge, and air-gapped environments.

You will work at the intersection of DevOps, MLOps, FinOps, and observability, delivering repeatable AI workloads with cost-conscious, traceable execution and strong telemetry across multi-tenant environments.