AI Systems Engineer: DevOps & Observability

EY; Stamford (CT); Hybrid; USD 107,000 - 177,000; Full time

Benefits offered by this job

Hybrid work model

Medical and dental coverage

401(k) and pension benefits

Job summary

EY is seeking an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of EY’s AI-native platform. This role spans CI/CD pipelines, secure model execution, and end-to-end cost visibility across cloud, on‑prem, edge, and air‑gapped environments.

You’ll work across DevOps, MLOps, FinOps, and observability, ensuring repeatable, auditable AI workloads with scalable governance and telemetry. EY offers a hybrid work model and diverse, inclusive teams.

Qualifications

• Hands-on ownership of AI or high-throughput services.
• CI/CD/CV pipelines and GitOps tooling experience.
• Experience with Ray Serve, vLLM, Triton, or NIM on GPUs.
• Familiar with OpenTelemetry and observability stacks.
• Experience with registries and SBOM scanning.

Responsibilities

• Develop and operate CI/CD/CV pipelines for AI workloads.
• Manage AI asset governance and model metadata.
• Control cost attribution and quotas for tenants.
• Own observability stack including metrics, logs, traces.
• Ensure multi-environment delivery and rollback.

Skills

DevOps

MLOps

Observability

FinOps

Model governance

OpenTelemetry

Multi-tenant

Education

Bachelor’s or Master’s degree

Tools

Ray Serve

vLLM

Triton

NIM

OpenTelemetry

Prometheus

Grafana

Loki

Envoy

Job description

EY is seeking an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of EY’s AI-native platform. This role spans CI/CD pipelines, secure model execution, and end-to-end cost visibility across cloud, on‑prem, edge, and air‑gapped environments.

You’ll work across DevOps, MLOps, FinOps, and observability, ensuring repeatable, auditable AI workloads with scalable governance and telemetry. EY offers a hybrid work model and diverse, inclusive teams.