Senior AI Stateful Data Infrastructure Engineer

EY; St. Louis (MO); Hybrid; USD 107,000 - 177,000; Full time

Benefits offered by this job

Medical and dental coverage

401(k) plan

Paid time off

Job summary

EY seeks an AI Systems Engineer to own the stateful backbone of EY’s AI-native platform, spanning data stores, memory tiers, and event streaming across cloud, on-prem, edge, and air-gapped environments. You’ll own relational, vector, graph stores, and durable workflows with strong emphasis on durability and recoverability.

You will also architect and operate streaming pipelines and schema governance to ensure reliable cross-environment data movement, while enabling multi-tenant isolation and

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related technical field.
• 8+ years operating production data infrastructure, streaming systems, or database platforms at scale.
• Hands-on expertise with relational databases (PostgreSQL) and caching (Redis/Valkey), including HA, replication, and backup/recovery.
• Exposure to AI/ML data patterns — embeddings, retrieval, feature/state stores for agentic workloads.
• Production experience with vector and/or graph databases (Qdrant, Milvus, PGVector, Neo4j) in AI/ML contexts.
• Deep experience with event streaming and messaging (Apache Kafka/Strimzi, NATS) and change data capture (Debezium).
• Experience with stream processing (Apache Flink) and event/schema governance (CloudEvents, schema registry).
• Experience running stateful systems on Kubernetes (operators, persistent volumes, object/storage like MinIO/OpenEBS).
• Ability to define clean ownership boundaries and data/schema contracts with platform, trust, runtime, and delivery teams.

Responsibilities

• Own the memory and data stores: relational and durable state, caching, vector stores, graph stores, and object storage across environments.
• Own event streaming and async messaging: Kafka, NATS JetStream, Debezium, Flink, and schema contracts.
• Own data durability, consistency, and recoverability: replication, backup/restore, point-in-time recovery, cross-environment data movement.
• Build and operate streaming and CDC pipelines with schema governance to prevent breaking changes.
• Make state multi-tenant and portable with isolation and performance across managed cloud and self-hosted OSS.
• Provide the data and lineage substrate for governance, observability, and AI knowledge capabilities; integrate with lineage tooling.

Skills

Data infrastructure

Streaming systems

Kubernetes

Regulatory compliance

Schema governance

Multi-tenant

Reliability engineering

Education

Bachelor’s or Master’s degree in Computer Science or related field

Tools

PostgreSQL

Redis

Valkey

Qdrant

Milvus

PGVector

Neo4j

MinIO

OpenEBS

Apache Kafka

Strimzi

NATS

Debezium

Flink

Job description

EY seeks an AI Systems Engineer to own the stateful backbone of EY’s AI-native platform, spanning data stores, memory tiers, and event streaming across cloud, on-prem, edge, and air-gapped environments. You’ll own relational, vector, graph stores, and durable workflows with strong emphasis on durability and recoverability.

You will also architect and operate streaming pipelines and schema governance to ensure reliable cross-environment data movement, while enabling multi-tenant isolation and