AI Platform Engineer: Observability, Pipelines & FinOps

EY; Austin (TX); Hybrid; USD 126,000 - 230,000; Full time

Benefits offered by this job

Hybrid work model

Total rewards package

Job summary

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability for EY’s AI-native platform. You will manage CI/CD pipelines, governance of AI assets, cost attribution, and a comprehensive observability stack across cloud, on-prem, edge, and air-gapped environments.

You will work across DevOps, MLOps, FinOps, and observability, ensuring secure model execution and repeatable delivery in regulated contexts.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related technical field required.
• 8+ years in DevOps, MLOps, platform, or observability engineering with hands-on ownership of AI or high-throughput services.
• Hands-on with CI/CD/CV pipelines and GitOps tooling for automated build, test, release, and rollback.
• Hands-on expertise operating inference/model-serving frameworks on GPU infrastructure.
• Strong observability experience with Prometheus, Grafana, Loki, Tempo/Jaeger, and OpenTelemetry.
• Experience with API gateways and request routing, including streaming responses.
• Experience with cost management / FinOps tooling and quota/rate-limit enforcement.
• Familiarity with model/artifact registries and supply-chain scanning.

Responsibilities

• Own DevOps and delivery for AI workloads: CI/CD/CV pipelines that ship AI services and runtime components with automated build, test, verification, release, and rollback.
• Own governance and discovery for AI assets including registries and metadata.
• Own resource and cost management with quotas and attribution by tenant.
• Own the full observability stack: metrics, logs, traces, dashboards, debugging and evaluation tools.
• Own OpenTelemetry collection layer including multi-tenant receivers and GPU telemetry.
• Automate GitOps-based delivery and continuous verification with policy gates.
• Drive deployment decisions, progressive rollout, and automated rollback using telemetry and cost signals.
• Ensure cost and telemetry are identity-stamped and per-tenant.

Skills

DevOps

GitOps

CI/CD

MLOps

Observability

Cost optimization

Communication

Education

Bachelor’s or Master’s in Computer Science or related field

Tools

ArgoCD

Helm

GitHub Actions / GitLab CI

Ray Serve

vLLM

Triton

NIM

Prometheus

Grafana

Loki

Tempo/Jaeger

OpenTelemetry

Envoy

OpenLineage

Harbor

MLflow

Trivy

OpenCost

Kubecost

LangSmith

Langfuse

gVisor

Firecracker

DCGM

Job description

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability for EY’s AI-native platform. You will manage CI/CD pipelines, governance of AI assets, cost attribution, and a comprehensive observability stack across cloud, on-prem, edge, and air-gapped environments.

You will work across DevOps, MLOps, FinOps, and observability, ensuring secure model execution and repeatable delivery in regulated contexts.