Senior AI Data & State Infrastructure Engineer

Ernst & Young Advisory Services Sdn Bhd; Atlanta (GA); Hybrid; USD 107,000 - 177,000; Full time

Benefits offered by this job

Hybrid work model

Medical and dental coverage

Paid time off

Job summary

EY seeks an AI Systems Engineer to own the stateful backbone of EY’s AI-native platform, spanning data stores, memory tiers, and streaming systems across cloud, on-prem, edge, and air-gapped environments.

This role focuses on durable, consistent access to data for agentic AI workloads, operating across PostgreSQL, Redis, vector/graph stores, and durable workflows, while ensuring multi-tenant isolation and scalable performance.

Qualifications

• 8+ years operating production data infrastructure, streaming systems, or database platforms at scale.
• Experience with relational databases (PostgreSQL) and caching (Redis/Valkey), including HA, replication, and backup/recovery.
• Exposure to AI/ML data patterns — embeddings, retrieval, feature/state stores for agentic workloads.
• Production experience with vector and/or graph databases (Qdrant, Milvus, PGVector, Neo4j) in AI/ML contexts.
• Deep experience with event streaming and messaging (Apache Kafka/Strimzi, NATS) and change data capture (Debezium).
• Experience with stream processing (Apache Flink) and event/schema governance (CloudEvents, schema registry).
• Experience running stateful systems on Kubernetes (operators, persistent volumes, object/storage).
• Ability to define clean ownership boundaries and data/schema contracts with platform, trust, runtime, and delivery teams.

Responsibilities

• Own the memory and data stores: relational and durable state, caching, vector stores, knowledge graphs, and object storage across environments.
• Own event streaming and async messaging: Kafka, NATS JetStream, Debezium, Flink, and CloudEvents.
• Own data durability, consistency, and recoverability: replication, backup/restore, PITR, cross-environment data movement.
• Build and operate streaming and CDC pipelines with schema governance to avoid breaking changes.
• Make state multi-tenant and portable, ensuring isolation and performance across managed cloud or self-hosted OSS.
• Provide the data and lineage substrate for governance, observability, and AI knowledge capabilities.

Skills

Relational databases

Streaming systems

Kubernetes

Data durability

Multi-tenant/data isolation

Schema governance

Communicator

Automation and IaC

Education

Bachelor’s or Master’s degree in Computer Science

Tools

PostgreSQL

Redis/Valky

Qdrant

Milvus

PGVector

Neo4j

MinIO/OpenEBS

Kafka/Strimzi

NATS JetStream

Debezium

Apache Flink

Job description

EY seeks an AI Systems Engineer to own the stateful backbone of EY’s AI-native platform, spanning data stores, memory tiers, and streaming systems across cloud, on-prem, edge, and air-gapped environments.

This role focuses on durable, consistent access to data for agentic AI workloads, operating across PostgreSQL, Redis, vector/graph stores, and durable workflows, while ensuring multi-tenant isolation and scalable performance.