Senior AI Infra, DevOps & Observability Engineer

EY; Washington (District of Columbia); Híbrido; USD 107 000 - 177 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Medical and dental coverage

Pension/401(k)

Paid time off

Resumo da oferta

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability across EY’s AI-native platform. You’ll work across cloud, on-prem, edge, and air-gapped environments, building automated pipelines and secure model execution.

You should be comfortable operating inference at scale on GPUs, with strong focus on cost visibility, governance, and deep observability across services. EY offers hybrid work and a comprehensive rewards package.

Qualificações

• 8+ years in DevOps, MLOps, platform, or observability engineering.
• Hands-on DevOps with CI/CD/CV pipelines and GitOps tooling.
• Hands-on expertise operating inference/model-serving on GPUs.
• Strong observability experience with Prometheus, Grafana and OpenTelemetry.
• Experience with API gateways and request routing.
• Experience with FinOps tooling and cost attribution.
• Familiarity with model registries and supply-chain scanning.
• Proven track record delivering AI workloads under regulatory constraints.
• Ability to define ownership boundaries and consumption contracts.

Responsabilidades

• Build and operate CI/CD/CV pipelines that ship AI services and runtimes.
• Own governance and discovery for AI assets and model metadata.
• Manage resource cost attribution and quota enforcement.
• Own the full observability stack: metrics, logs, traces, dashboards.
• Own OpenTelemetry collection layer for multi-tenant signals.
• Automate GitOps-based delivery with policy gates.
• Link delivery and observability to enable automated rollbacks.
• Ensure per-tenant telemetry ties to workloads for FinOps.

Conhecimentos

CI/CD pipelines

GitOps

OpenTelemetry

MLOps

GPU inference

Cost governance

Observability

Envoy

Formação académica

Bachelor’s or Master’s degree in Computer Science

Ferramentas

Ray Serve

vLLM

Triton

NIM

Prometheus

Grafana

Loki

Tempo/Jaeger

OpenLineage

Descrição da oferta de emprego

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing, and observability across EY’s AI-native platform. You’ll work across cloud, on-prem, edge, and air-gapped environments, building automated pipelines and secure model execution.

You should be comfortable operating inference at scale on GPUs, with strong focus on cost visibility, governance, and deep observability across services. EY offers hybrid work and a comprehensive rewards package.