AI Systems Engineer: DevOps, Model Serving & Observability

EY; Carson City (NV); Remote; USD 107,000 - 177,000; Full time

Benefits offered by this job

Medical and dental coverage

Pension and 401(k)

Paid time off

Job summary

EY is seeking an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of our AI-native platform. You will manage CI/CD/CV pipelines, governance of AI assets, cost attribution, and a robust observability stack across cloud, on-prem, edge, and air-gapped environments.

You will work at the intersection of DevOps, MLOps, FinOps, and observability, ensuring repeatable, compliant AI workloads, protected by policy-driven gates and full telemetry.

Qualifications

• 8+ years in DevOps, MLOps, platform, or observability engineering with production ownership of AI or high-throughput services.

Responsibilities

• Support DevOps and delivery for AI workloads: build/operate CI/CD/CV pipelines including automated build, test, verification, release, and rollback.
• Own governance and discovery for AI assets and registries (Artifactory/Nexus, Harbor, MLflow, HuggingFace/NGC).
• Own resource and cost management with quotas, rate limits, OpenCost or Kubecost for per-tenant attribution.
• Own the full observability stack: metrics (Prometheus), logs (Loki), traces (Tempo/Jaeger), dashboards (Grafana).
• Own the OpenTelemetry collection layer across multi-tenant environments for reliable signal routing.
• Automate GitOps-based delivery with policy-driven quality and cost gates in pipelines.
• Close loop between delivery and observability to drive deployment decisions and automated rollback.
• Ensure cost/telemetry are per-tenant and tied to workloads for FinOps accountability.

Skills

DevOps

MLOps

Observability

FinOps

Model governance

Multi-tenant

Communication skills

Education

Bachelor’s or Master’s degree in Computer Science or related field

Tools

Ray Serve

vLLM

Triton

NIM

Prometheus

Grafana

Loki

Tempo/Jaeger

LangSmith

Langfuse

OpenTelemetry

OpenCost

Kubecost

Harbor

MLflow

Trivy

OpenLineage

Job description

EY is seeking an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of our AI-native platform. You will manage CI/CD/CV pipelines, governance of AI assets, cost attribution, and a robust observability stack across cloud, on-prem, edge, and air-gapped environments.

You will work at the intersection of DevOps, MLOps, FinOps, and observability, ensuring repeatable, compliant AI workloads, protected by policy-driven gates and full telemetry.