Senior AI Stateful Data Infrastructure Engineer

EY; Austin (TX); Hybrid; USD 107,000 - 177,000; Full time

Benefits offered by this job

Hybrid work model

Paid time off

Medical and dental coverage

Job summary

EY is seeking an AI Systems Engineer to own the stateful backbone of EY’s AI-native platform, managing data stores, memory tiers, and event streaming across cloud, on-prem, edge, and air-gapped environments.

You will ensure durability and consistent access to data for agentic AI workloads, spanning PostgreSQL, Redis, vector/graph stores, and durable workflows, while enabling multi-tenant portability in a regulated context.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related field.
• 8+ years operating production data infrastructure, streaming systems, or database platforms at scale.
• Hands-on expertise with PostgreSQL and caching (Redis/Valkey), including HA, replication, and backup/recovery.
• Exposure to AI/ML data patterns — embeddings, retrieval, feature/state stores for agentic workloads.
• Production experience with vector and/or graph databases (Qdrant, Milvus, PGVector, Neo4j) in AI/ML contexts.
• Deep experience with event streaming and messaging (Apache Kafka/Strimzi, NATS) and change data capture (Debezium).
• Experience with stream processing (Apache Flink) and event/schema governance (CloudEvents, schema registry).
• Experience running stateful systems on Kubernetes (operators, persistent volumes, object/storage like MinIO/OpenEBS).
• Ability to define clean ownership boundaries and data/schema contracts with platform, trust, runtime, and delivery teams.

Responsibilities

• Own the memory and data stores: relational and durable state, caching, vector stores, knowledge graphs, and object storage.
• Own event streaming and async messaging: Kafka, NATS JetStream, Debezium, Flink, and schema contracts.
• Own data durability, consistency, and recoverability: replication, backup/restore, PITR, cross-environment data movement.
• Build and operate streaming and CDC pipelines with schema governance and evolution.
• Make state multi-tenant and portable across managed cloud and self-hosted OSS in cloud, on-prem, edge, and air-gapped environments.
• Provide the data and lineage substrate for governance, observability, and AI knowledge capabilities.

Skills

PostgreSQL

Redis/Valkey

Kafka

NATS

Debezium

Flink

Kubernetes

Neo4j

Qdrant

Milvus

PGVector

Data governance

Education

Bachelor’s or Master’s degree in Computer Science or related field

Tools

MinIO

OpenEBS

Strimzi

Temporal

Job description

EY is seeking an AI Systems Engineer to own the stateful backbone of EY’s AI-native platform, managing data stores, memory tiers, and event streaming across cloud, on-prem, edge, and air-gapped environments.

You will ensure durability and consistent access to data for agentic AI workloads, spanning PostgreSQL, Redis, vector/graph stores, and durable workflows, while enabling multi-tenant portability in a regulated context.