Stateful AI Data Infrastructure Engineer

EY; Dallas (TX); Hybrid; USD 107,000 - 177,000; Full time

Benefits offered by this job

Hybrid work model

Competitive compensation

Paid time off

Total Rewards: medical, dental, 401(k)

Job summary

EY is seeking an AI Systems Engineer to own the stateful backbone of EY’s AI-native platform, including data stores, memory tiers, and event streaming systems across cloud, on-prem, edge, and air-gapped environments. You’ll ensure durability, consistency, and recoverability for agentic workloads.

The role focuses on multi-environment state, schema governance, and data lineage to enable governance, observability, and AI knowledge capabilities across teams. Hybrid work model.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related technical field.
• 8+ years operating production data infrastructure, streaming systems, or database platforms at scale.
• Hands-on expertise with relational databases (PostgreSQL) and caching (Redis/Valkey), including HA, replication, and backup/recovery.
• Exposure to AI/ML data patterns — embeddings, retrieval, feature/state stores for agentic workloads.
• Production experience with vector and/or graph databases (Qdrant, Milvus, PGVector, Neo4j) in AI/ML contexts.
• Deep experience with event streaming and messaging (Apache Kafka/Strimzi, NATS) and change data capture (Debezium).
• Experience with stream processing (Apache Flink) and event/schema governance (CloudEvents, schema registry).
• Experience running stateful systems on Kubernetes (operators, persistent volumes, object/block storage such as MinIO/OpenEBS).
• Ability to define clean ownership boundaries and data/schema contracts with platform, trust, runtime, and delivery teams.

Responsibilities

• Own memory and data stores across environments and tenants.
• Own event streaming and async messaging components.
• Ensure durability, consistency, and recoverability across environments.
• Build streaming and CDC pipelines with schema governance.
• Make state multi-tenant and portable with isolation and performance.
• Provide data and lineage substrate for governance and AI knowledge capabilities.

Skills

Data infrastructure

Streaming architectures

Reliability & recoverability

Multi-tenant isolation

Schema governance

Education

Bachelor’s or Master’s degree in Computer Science or related

Tools

PostgreSQL

Redis

Qdrant

Milvus

Neo4j

MinIO

OpenEBS

Kafka

NATS

Debezium

Flink

CloudEvents

Kubernetes

Temporal

OpenLineage

Marquez

Job description

EY is seeking an AI Systems Engineer to own the stateful backbone of EY’s AI-native platform, including data stores, memory tiers, and event streaming systems across cloud, on-prem, edge, and air-gapped environments. You’ll ensure durability, consistency, and recoverability for agentic workloads.

The role focuses on multi-environment state, schema governance, and data lineage to enable governance, observability, and AI knowledge capabilities across teams. Hybrid work model.