AI Systems Engineer: DevOps, Delivery & Observability

EY; Dallas (TX); Hybrid; USD 107,000 - 177,000; Full time

Benefits offered by this job

Medical and dental coverage

Pension and 401(k) plans

Paid time off options

Job summary

EY seeks an AI Systems Engineer to own delivery, model-serving, routing, and observability for its AI-native platform. You will manage CI/CD, governance of AI assets, and cost controls across cloud, on‑prem, edge, and air‑gapped environments.

Role entails operating inference systems on GPUs, building deep observability, and enabling compliant, scalable AI workloads with strong collaboration across DevOps, MLOps, and security teams.

Qualifications

• 8+ years in DevOps, MLOps, platform, or observability engineering with production ownership of AI or high-throughput services.
• Strong hands-on DevOps experience including CI/CD/CV pipelines and GitOps tooling for automated build, test, release, and rollback.
• Hands-on expertise operating inference/model-serving frameworks on GPU infrastructure.
• Experience with observability stacks and OpenTelemetry.
• Experience with API gateways and request routing, including streaming responses.
• Experience with cost management tools and quota enforcement.
• Familiarity with model/artifact registries and registry tools.

Responsibilities

• Supports DevOps and delivery for AI workloads: build and operate CI/CD/CV pipelines to ship AI services and runtime components.
• Own governance and discovery for AI assets including registries, experiment tracking, and license management.
• Own resource and cost management with quotas and attribution to keep AI execution bounded.
• Own the full observability stack, including metrics, logs, traces, dashboards, and SLA alerts.
• Automate GitOps-based delivery with embedded quality and cost gates.
• Drive deployment decisions and automated rollback using telemetry and cost signals.
• Ensure per-tenant identity stamping for FinOps and observability.

Skills

DevOps expertise

Model-serving systems

Observability

FinOps mindset

Governance and registry awareness

Cross-cloud / edge environments

Clear communication

Education

Bachelor’s or Master’s degree in Computer Science or related field

Tools

Ray Serve

vLLM/Triton/NIM

Prometheus

Grafana

Loki

Tempo/Jaeger

OpenTelemetry

Envoy

Harbor

MLflow

Trivy

Kubecost

Job description

EY seeks an AI Systems Engineer to own delivery, model-serving, routing, and observability for its AI-native platform. You will manage CI/CD, governance of AI assets, and cost controls across cloud, on‑prem, edge, and air‑gapped environments.

Role entails operating inference systems on GPUs, building deep observability, and enabling compliant, scalable AI workloads with strong collaboration across DevOps, MLOps, and security teams.