Senior AI Data & State Platform Engineer

EY; Irvine (CA); Hybrid; USD 128,000 - 201,000; Full time

Benefits offered by this job

Medical and dental coverage

Pension and 401(k)

Job summary

EY is seeking an AI Systems Engineer to own the stateful backbone of EY’s AI-native platform, including data stores, memory tiers, and event streaming systems that hold and move state across cloud, on‑prem, edge, client‑managed, and air‑gapped environments.

This role covers relational, key‑value, vector, graph stores, object storage, durable workflows, and streaming/CDC pipelines, with governance and multi‑tenant portability across environments.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related field.
• 8+ years operating production data infrastructure, streaming systems, or database platforms at scale.
• Hands-on expertise with PostgreSQL and caching (Redis/Valkey), including HA, replication, and backup/recovery.
• Exposure to AI/ML data patterns — embeddings, retrieval, feature/state stores.
• Production experience with vector/graph databases (Qdrant, Milvus, PGVector, Neo4j).
• Deep experience with event streaming and messaging (Kafka/Strimzi, NATS) and CDC (Debezium).
• Experience with stream processing (Flink) and schema governance (CloudEvents, schema registry).
• Experience running stateful systems on Kubernetes with persistent volumes and MinIO/OpenEBS.

Responsibilities

• Own the memory and data stores across environments: relational, key-value, vector, graph, and object storage.
• Own event streaming and async messaging: Kafka, NATS JetStream, Debezium, Flink, and CloudEvents schemas.
• Ensure data durability, consistency, and recoverability across cross‑environment data movement.
• Build and operate streaming and CDC pipelines with schema governance to prevent breaking changes.
• Make state multi-tenant and portable with isolation and performance in cloud or air‑gapped setups.
• Provide data and lineage substrate supporting governance, observability, and AI knowledge capabilities.

Skills

Relational databases

Key-value stores

Vector/Graph databases

Streaming systems

PostgreSQL HA/backups

Redis/Valkey caching

Kafka/NATS/CDC

Flink/stream processing

Kubernetes

Open-source storage (MinIO/OpenEBS)

Education

Bachelor’s or Master’s degree in Computer Science or related technical field

Tools

PostgreSQL

Redis

Valkey

Qdrant

Milvus

PGVector

Neo4j

Debezium

Strimzi

CloudEvents

OpenLineage

MinIO

OpenEBS

Temporal/DBOS

Job description

EY is seeking an AI Systems Engineer to own the stateful backbone of EY’s AI-native platform, including data stores, memory tiers, and event streaming systems that hold and move state across cloud, on‑prem, edge, client‑managed, and air‑gapped environments.

This role covers relational, key‑value, vector, graph stores, object storage, durable workflows, and streaming/CDC pipelines, with governance and multi‑tenant portability across environments.