AI Systems Engineer - DevOps, Observability & Model Serving

EY; San Diego (CA); On-site; USD 107,000 - 177,000; Full time

Benefits offered by this job

Competitive compensation

Hybrid/Remote work options

Health and dental coverage

Pension and 401(k)

Paid time off

Job summary

EY seeks an AI Systems Engineer to own the delivery, model-serving, routing, and observability of EY’s AI-native platform. You will shape how AI services are built and how models run across cloud, on‑prem, and edge environments.

The role sits at the intersection of DevOps, MLOps, FinOps, and observability, requiring hands‑on experience with CI/CD, GPUs, and OpenTelemetry. Collaboration with platform, trust, and data teams is essential to ensure repeatable delivery and transparent telemetry

Qualifications

• 8+ years in DevOps, MLOps, platform, or observability engineering.
• Hands-on CI/CD/CV pipelines and GitOps tooling.
• Hands-on expertise operating inference/model-serving frameworks on GPU infrastructure.
• Strong observability stacks (Prometheus/Grafana/Loki) and OpenTelemetry.
• Experience with API gateways and request routing (Envoy).
• Experience with cost management / FinOps tooling and quota enforcement.
• Familiarity with model/artifact registries and license/lineage tracking.
• Proven track record operating AI/service infrastructure under regulatory constraints.

Responsibilities

• Supports DevOps and delivery for AI workloads: CI/CD/CV pipelines, automated build, test, release, rollback.
• Own governance and discovery for AI assets, model metadata, registries, and licenses.
• Own resource and cost management with quotas and per-tenant attribution.
• Own the full observability stack: metrics, logs, traces, dashboards.
• Own OpenTelemetry collection layer and GPU telemetry exposure.
• Automate GitOps-based delivery with policy gates in pipelines.
• Close the loop between delivery and observability using telemetry and cost signals.
• Ensure identity stamping and per-tenant accountability across workloads.

Skills

DevOps expertise

Observability

FinOps mindset

Communication

Cost attribution

Education

Bachelor's or Master’s degree in Computer Science or related technical field

Tools

Envoy

Kubecost

Harbor

MLflow

OpenCost

OpenLineage

Job description

EY seeks an AI Systems Engineer to own the delivery, model-serving, routing, and observability of EY’s AI-native platform. You will shape how AI services are built and how models run across cloud, on‑prem, and edge environments.

The role sits at the intersection of DevOps, MLOps, FinOps, and observability, requiring hands‑on experience with CI/CD, GPUs, and OpenTelemetry. Collaboration with platform, trust, and data teams is essential to ensure repeatable delivery and transparent telemetry