AI Platform Engineer: DevOps, Observability & FinOps

EY; Charlotte (NC); Hybrid; USD 107,000 - 177,000; Full time

Benefits offered by this job

Medical and dental coverage

Pension and 401(k) plans

Paid time off

Job summary

EY in the United States seeks an AI Systems Engineer to own the delivery, model-serving, routing and observability for EY’s AI-native platform. The role spans CI/CD pipelines, secure model execution, and cost-facing telemetry across cloud, on-prem, edge and air-gapped environments.

You’ll operate at the intersection of DevOps, MLOps, FinOps and observability, partnering with engineers to ship AI workloads repeatably with strong cost visibility and regulatory awareness.

Qualifications

• 8+ years in DevOps, MLOps, platform, or observability engineering.
• Hands-on DevOps experience with CI/CD/CV pipelines and GitOps tooling.
• Expertise operating inference/model-serving frameworks on GPUs.
• Strong observability stacks (Prometheus, Grafana, Loki, Tempo/Jaeger) and OpenTelemetry.
• Experience with API gateways and request routing (Envoy).
• Experience with FinOps tooling and cost attribution.
• Familiarity with model/artifact registries and governance tools.
• Proven ability to operate AI/service infrastructure under compliance constraints.

Responsibilities

• Build and operate CI/CD/CV pipelines for AI services and runtime components.
• Own governance and discovery for AI assets and registries.
• Manage resource and cost attribution per tenant and engagement.
• Own the full observability stack and alerting for AI workloads.
• Own OpenTelemetry collection across multi-tenant environments.
• Automate GitOps delivery with policy gates and automated verification.
• Drive deployment decisions via telemetry, evaluation, and cost signals.
• Ensure end-to-end traceability and regulatory compliance.

Skills

CI/CD pipelines

GitOps tooling

OpenTelemetry

GPU inference systems

Observability

Cost management

Model-serving frameworks

Envoy / API gateways

LangSmith / Langfuse

Education

Bachelor’s or Master’s in Computer Science or related field

Tools

Ray Serve

vLLM

Triton

NIM

Prometheus

Grafana

Loki

Tempo

Jaeger

OpenLineage

Harbor

MLflow

Trivy

Kubecost

OpenCost

Job description

EY in the United States seeks an AI Systems Engineer to own the delivery, model-serving, routing and observability for EY’s AI-native platform. The role spans CI/CD pipelines, secure model execution, and cost-facing telemetry across cloud, on-prem, edge and air-gapped environments.

You’ll operate at the intersection of DevOps, MLOps, FinOps and observability, partnering with engineers to ship AI workloads repeatably with strong cost visibility and regulatory awareness.