AI Platform Engineer: DevOps, Observability & FinOps

EY; Akron (OH); On-site; USD 107,000 - 177,000; Full time

Benefits offered by this job

Hybrid work model

Medical and dental coverage

401(k) plan

Job summary

EY seeks an AI Systems Engineer to own delivery, model-serving, routing, and observability across EY’s AI-native platform. You will shape runtime, governance, and cost visibility across cloud, on-prem, edge, and air-gapped environments, working with senior engineers to test and develop capabilities.

You will mentor on DevOps for AI workloads, orchestrate model-serving at scale, and drive cost-aware, observable AI delivery through automated pipelines and governance.

Qualifications

• 8+ years in DevOps, MLOps, platform, or observability engineering with hands-on ownership of AI or high-throughput services.
• Hands-on DevOps including CI/CD pipelines and GitOps tooling for automated build, test, release, and rollback.
• Hands-on expertise operating inference/model-serving frameworks on GPU infrastructure.
• Strong experience with observability stacks and OpenTelemetry.
• Experience with cost management and quota enforcement.
• Familiarity with model/artifact registries and lineage tracking.

Responsibilities

• Supports DevOps and delivery for AI workloads: build and operate CI/CD/CV pipelines that ship AI services, agents, and runtime components.
• Own governance and discovery for AI assets and metadata, registries, and licenses.
• Own resource and cost management with quotas and rate limits to keep AI execution bounded.
• Own the full observability stack: metrics, logs, traces, dashboards, and evaluation tooling.
• Own the OpenTelemetry collection layer for multi-tenant, reliable signal capture.
• Automate GitOps-based delivery and continuous verification with policy gates.

Skills

DevOps mastery

MLOps

Observability

FinOps mindset

Governance & registries

Cost attribution

Cloud & on-prem

Education

Bachelor's degree in CS or related field

Tools

Ray Serve

vLLM

Triton

NIM

Prometheus

Grafana

Loki

Tempo/Jaeger

OpenTelemetry

Job description

EY seeks an AI Systems Engineer to own delivery, model-serving, routing, and observability across EY’s AI-native platform. You will shape runtime, governance, and cost visibility across cloud, on-prem, edge, and air-gapped environments, working with senior engineers to test and develop capabilities.

You will mentor on DevOps for AI workloads, orchestrate model-serving at scale, and drive cost-aware, observable AI delivery through automated pipelines and governance.