Senior AI Systems Engineer: DevOps, Observability & FinOps

Ernst & Young Oman; New Brunswick (NJ); Hybrid; USD 107,000 - 177,000; Full time

Job summary

EY is seeking an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of EY's AI-native platform. This role sits at the intersection of DevOps, MLOps, FinOps, and observability across cloud, on-prem, edge, and air-gapped environments, delivering AI workloads in a repeatable, governed manner.

Ideal candidates have 8+ years of experience with GPU inference, OpenTelemetry, and scalable observability, plus hands-on experience with Ray Serve, vLLM, and

Qualifications

• 8+ years in DevOps, MLOps, platform, or observability engineering with production ownership of AI or high-throughput services.
• Hands-on DevOps experience with CI/CD/CV pipelines and GitOps tooling for automated build, test, release, and rollback.
• Hands-on expertise operating inference/model-serving frameworks on GPU infrastructure.
• Strong experience with observability stacks and OpenTelemetry.
• Experience with API gateways and request routing, including streaming responses.
• Experience with cost management / FinOps tooling and quota enforcement.
• Familiarity with model/artifact registries and supply-chain scanning.
• Proven track record in regulated delivery environments.

Responsibilities

• Supports DevOps and delivery for AI workloads: build and operate CI/CD/CV pipelines delivering AI services and runtime components.
• Own governance and discovery for AI assets and model metadata with registries and license management.
• Own resource and cost management to keep AI execution economically bounded per tenant.
• Own the full observability stack: metrics, logs, traces, dashboards, and AI debugging tools.
• Own the OpenTelemetry collection layer and GPU telemetry exporters.
• Automate GitOps-based delivery and verification with policy gates.
• Close the loop between delivery and observability using telemetry and cost signals for deployments.
• Ensure identity-stamped cost and telemetry per-tenant across workloads.

Skills

CI/CD pipelines

GitOps tooling

GPU inference

OpenTelemetry

Observability

Education

Bachelor's degree in Computer Science or related field

Tools

Ray Serve

vLLM/Triton

LangSmith

Langfuse

Prometheus

Grafana

Loki

Envoy

Job description

EY is seeking an AI Systems Engineer to own the delivery, model-serving, routing, and observability layer of EY's AI-native platform. This role sits at the intersection of DevOps, MLOps, FinOps, and observability across cloud, on-prem, edge, and air-gapped environments, delivering AI workloads in a repeatable, governed manner.

Ideal candidates have 8+ years of experience with GPU inference, OpenTelemetry, and scalable observability, plus hands-on experience with Ray Serve, vLLM, and