AI DevOps & Observability Lead (Remote)

EY; Columbus (OH); Hybrid; USD 126,000 - 230,000; Full time

Benefits offered by this job

Medical and dental coverage

Pension and 401(k)

Paid time off

Job summary

EY is seeking an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of EY’s AI-native platform. You will own the CI/CD pipelines, governance, cost management, and multi-environment observability across cloud and on‑prem environments.

You will work at the intersection of DevOps, MLOps, FinOps, and observability, building automated delivery pipelines and secure model execution with a focus on repeatability and cost controls.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related technical field.
• 8+ years in DevOps, MLOps, platform, or observability engineering with hands-on ownership of AI or high-throughput services.
• Hands-on DevOps experience with CI/CD/CV pipelines and GitOps tooling (ArgoCD, Helm, GitHub Actions/GitLab CI).
• Hands-on expertise operating inference/model-serving frameworks (Ray Serve, vLLM, Triton, or NIM) on GPU infrastructure.
• Strong observability stacks (Prometheus, Grafana, Loki, Tempo/Jaeger) and OpenTelemetry.
• Experience with API gateways and request routing (Envoy) including streaming responses.
• Experience with FinOps tooling (OpenCost, Kubecost) and quota enforcement.
• Familiarity with model/artifact registries and supply-chain scanning (Harbor, MLflow, Trivy).
• Proven track record operating AI/service infra under compliance/security constraints.
• Ability to define ownership boundaries and consumption contracts with platform/trust/data teams.

Responsibilities

• Own DevOps and delivery for AI workloads: CI/CD/CV pipelines, automated build, test, release, and rollback.
• Own governance and discovery for AI assets and registries and metadata.
• Own resource and cost management, including quotas and rate limits, cost attribution.
• Own the full observability stack: metrics, logs, traces, dashboards, DLO tooling and evaluation.

Skills

DevOps expertise

Observability

FinOps mindset

Model governance

Cross‑cloud ops

Education

Bachelor’s or Master’s degree in Computer Science

Tools

ArgoCD

Helm

GitHub Actions

GitLab CI

Job description

EY is seeking an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of EY’s AI-native platform. You will own the CI/CD pipelines, governance, cost management, and multi-environment observability across cloud and on‑prem environments.

You will work at the intersection of DevOps, MLOps, FinOps, and observability, building automated delivery pipelines and secure model execution with a focus on repeatability and cost controls.