Senior AI Systems Engineer: Stateful Data & Streams

EY; Kansas City (MO); Hybrid; USD 107,000 - 177,000; Full time

Job summary

EY seeks an AI Systems Engineer to own the stateful backbone of EY’s AI-native platform, including data stores, memory tiers, and event streaming systems across cloud, on-prem, edge, and air-gapped environments.

You will manage durable workflows, multi-tenant isolation, and schema evolution to ensure reliable, scalable AI workloads with strong data governance and rollback capabilities.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related field.
• 8+ years operating production data infrastructure, streaming systems, or database platforms at scale.
• Hands-on PostgreSQL and Redis/Valkey with HA, replication, and backup/recovery.
• Exposure to AI/ML data patterns — embeddings, retrieval, feature/state stores for agentic workloads.
• Production experience with vector and/or graph databases (Qdrant, Milvus, PGVector, Neo4j) in AI/ML contexts.
• Deep experience with event streaming and messaging (Kafka/Strimzi, NATS) and change data capture (Debezium).
• Experience with stream processing (Flink) and event/schema governance (CloudEvents, schema registry).
• Experience running stateful systems on Kubernetes (operators, persistent volumes, object/storage).

Responsibilities

• Own the memory and data stores across environments and tenants.
• Own event streaming and async messaging including Kafka, NATS, and Debezium.
• Own data durability, consistency, and recoverability across environments.
• Build and operate streaming and CDC pipelines with schema governance.
• Make state multi-tenant and portable with proper isolation and performance.
• Provide data and lineage substrate and integrate with lineage tooling.

Skills

Data infrastructure at scale

Streaming architectures

Reliability and recoverability

Cross-environment operations

Schema governance

Communication and guidance

Infrastructure as code

Education

Bachelor’s or Master’s degree in Computer Science or related field

Tools

PostgreSQL

Redis

Valkey

Qdrant

Milvus

PGVector

Neo4j

MinIO

OpenEBS

Mayastor

Kafka

Strimzi

NATS

Debezium

Flink

CloudEvents

Schema Registry

Kubernetes

DBOS

Temporal

Job description

EY seeks an AI Systems Engineer to own the stateful backbone of EY’s AI-native platform, including data stores, memory tiers, and event streaming systems across cloud, on-prem, edge, and air-gapped environments.

You will manage durable workflows, multi-tenant isolation, and schema evolution to ensure reliable, scalable AI workloads with strong data governance and rollback capabilities.