AI Platform Engineer - End-to-End AI Delivery

EY; Boca Raton (FL); Hybrid; USD 126,000 - 230,000; Full time

Benefits offered by this job

Hybrid work model

Total Rewards package: medical/dental,

Pension and 401(k)

Paid time off options

Job summary

EY is seeking an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of EY’s AI-native platform. You will manage CI/CD/CV pipelines, secure model execution, and governance across cloud, on-prem, edge, and air-gapped environments.

You will excel in delivering automated pipelines, high-performance inference, and deep observability while ensuring regulatory and economic bounds per tenant and engagement.

Qualifications

• 8+ years in DevOps, MLOps, platform, or observability engineering with hands-on ownership of AI or high-throughput services.
• Strong hands-on DevOps experience, including CI/CD/CV pipelines and GitOps tooling (ArgoCD, Helm, GitHub Actions/GitLab CI, or equivalents).
• Hands-on expertise operating inference/model-serving frameworks on GPU infrastructure.
• Strong experience with observability stacks (Prometheus, Grafana, Loki, Tempo/Jaeger) and OpenTelemetry.
• Experience with API gateways and request routing (Envoy or equivalent).
• Experience with cost management / FinOps tooling and quota/rate-limit enforcement.
• Familiarity with model/artifact registries and supply-chain scanning.
• Proven track record operating AI or service infrastructure under compliance constraints.
• Ability to define ownership boundaries and consumption contracts.

Responsibilities

• Own DevOps and delivery for AI workloads: CI/CD/CV pipelines, GitOps, automated build/test/verification/release and rollback across environments.
• Own governance and discovery for AI assets including registries, experiment tracking, and license management.
• Own resource and cost management including quotas and attribution to keep AI execution bounded per tenant.
• Own the full observability stack: metrics, logs, traces, dashboards, and AI evaluation tooling.
• Own the OpenTelemetry collection layer including multi-tenant receivers and GPU telemetry.
• Automate GitOps-based delivery and verification, embedding quality and cost gates.
• Close the loop between delivery and observability to drive deployment decisions and automated rollbacks.
• Ensure per-tenant telemetry and cost signals to tie FinOps to workloads.

Skills

DevOps

MLOps

Observability

OpenTelemetry

FinOps

AI workloads

GitOps

Platform engineering

Communication

Ownership

Education

Bachelor’s or Master’s degree in Computer Science or related technical field

Tools

Ray Serve

vLLM

Triton

NIM

Prometheus

Grafana

Loki

Tempo/Jaeger

Envoy

Harbor

MLflow

Trivy

OpenLineage

Kubecost

OpenCost

LangSmith

Langfuse

ArgoCD

Job description

EY is seeking an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of EY’s AI-native platform. You will manage CI/CD/CV pipelines, secure model execution, and governance across cloud, on-prem, edge, and air-gapped environments.

You will excel in delivering automated pipelines, high-performance inference, and deep observability while ensuring regulatory and economic bounds per tenant and engagement.