AI Platform Lead: DevOps, Observability & FinOps

EY; New Brunswick (NJ); Hybrid; USD 126,000 - 230,000; Full time

Benefits offered by this job

Hybrid work model

Medical and dental coverage

Pension and 401(k)

Paid time off

Job summary

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability across EY’s AI-native platform. You’ll manage CI/CD/CV pipelines, secure model execution, and cost governance in multi-environment runtimes, from cloud to air-gapped environments.

The role sits at the intersection of DevOps, MLOps, FinOps, and observability, requiring strong cross‑team collaboration and a proven track record in production AI infrastructure.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related technical field.
• 8+ years in DevOps, MLOps, platform, or observability engineering with hands-on production ownership of AI or high-throughput services.
• Hands-on DevOps experience with CI/CD/CV pipelines and GitOps tools for automated build, test, release, and rollback.
• Hands-on expertise operating inference/model-serving frameworks on GPU infrastructure.
• Strong observability stacks knowledge and OpenTelemetry.
• Experience with cost management/FinOps tooling and quota enforcement.
• Familiarity with model/artifact registries and governance.
• Regulated delivery environments experience.

Responsibilities

• Own DevOps and delivery for AI workloads, including CI/CD/CV pipelines and automated release/rollback.
• Own governance and discovery for AI assets and model metadata.
• Own cost attribution and utilization to keep AI execution economical.
• Own full observability stack: metrics, logs, traces, dashboards.
• Own OpenTelemetry collection layer across multi-tenant environments.
• Automate GitOps-based delivery with policy gates in pipelines.
• Close loop between delivery and observability to drive deployment decisions.
• Ensure cost and telemetry are per-tenant and attributable end-to-end.

Skills

DevOps

GitOps

CI/CD

OpenTelemetry

MLOps

Observability

Cost Management

GPU Inference

Model Serving

Regulatory Compliance

Education

Bachelor’s or Master’s degree in Computer Science or related technical field

Tools

Ray Serve

vLLM

Triton

NIM

Prometheus

Grafana

Loki

Tempo/Jaeger

Harbor

MLflow

Trivy

OpenLineage

Envoy

Job description

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability across EY’s AI-native platform. You’ll manage CI/CD/CV pipelines, secure model execution, and cost governance in multi-environment runtimes, from cloud to air-gapped environments.

The role sits at the intersection of DevOps, MLOps, FinOps, and observability, requiring strong cross‑team collaboration and a proven track record in production AI infrastructure.