AI Platform Engineer — DevOps & Observability

EY; San Jose (CA); Hybrid; USD 107,000 - 177,000; Full time

Job summary

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing and observability for the AI-native platform. This senior role blends DevOps, MLOps, FinOps and observability across cloud, on-prem, edge and air-gapped environments.

The candidate will own CI/CD/CV pipelines, governance for AI assets, cost management, and full observability with Prometheus, Grafana, Loki and Jaeger; advising on multi-tenant, secure execution and regulatory compliance.

Qualifications

• 8+ years in DevOps, MLOps, platform or observability engineering with ownership of AI or high-throughput services.
• Hands-on CI/CD/CV pipelines and GitOps tooling for automated build, test, release and rollback.
• Experience with inference/model-serving frameworks on GPU infrastructure.
• Strong observability stack experience and OpenTelemetry.
• Experience with API gateways and request routing, including streaming responses.
• Cost management tooling and quota/rate-limit enforcement.
• Familiarity with model/artifact registries and supply-chain scanning.
• Proven track record delivering AI/service infra under compliance and regulatory constraints.

Responsibilities

• Build and operate CI/CD/CV pipelines for AI services and runtime components.
• Own governance and discovery for AI assets and registries.
• Manage resource costs with attribution per tenant and workload.
• Oversee full observability stack and SLA/alerting.
• Automate GitOps-based delivery with quality and cost gates.
• Drive deployment decisions using telemetry and cost signals end-to-end.
• Ensure per-tenant identity stamping for FinOps and observability.

Skills

DevOps expertise

Model-serving

Observability

FinOps mindset

Governance

Multi-tenant delivery

Cloud/On-prem/Edge

Education

Bachelor's or Master's in CS or related field

Tools

Ray Serve

vLLM

Triton

NIM

Prometheus

Grafana

Loki

Tempo/Jaeger

LangSmith

Langfuse

Harbor

MLflow

Trivy

Job description

EY is seeking an AI Systems Engineer to own delivery, model-serving, routing and observability for the AI-native platform. This senior role blends DevOps, MLOps, FinOps and observability across cloud, on-prem, edge and air-gapped environments.

The candidate will own CI/CD/CV pipelines, governance for AI assets, cost management, and full observability with Prometheus, Grafana, Loki and Jaeger; advising on multi-tenant, secure execution and regulatory compliance.