AI Systems Engineer: Stateful Data & Streaming

EY; Atlanta (GA); Hybrid; USD 107,000 - 177,000; Full time

Job summary

EY seeks an AI Systems Engineer to own the stateful backbone of EY’s AI-native platform, spanning relational, vector, graph stores, and streaming pipelines across cloud, on-prem, edge, client-managed, and air-gapped environments.

You will ensure durability, consistency, and recoverability, build multi-tenant data substrates, and collaborate with teams to govern data lineage and schema contracts while advancing automation and IaC in regulated client contexts.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related field.
• 8+ years operating production data infrastructure, streaming systems, or database platforms at scale.
• Hands-on expertise with PostgreSQL and caching (Redis/Valkey), including HA, replication, and backup/recovery.
• Exposure to AI/ML data patterns — embeddings, retrieval, feature/state stores for agentic workloads.
• Production experience with vector and/or graph databases (Qdrant, Milvus, PGVector, Neo4j) in AI/ML contexts.
• Deep experience with event streaming and messaging (Apache Kafka/Strimzi, NATS) and change data capture (Debezium).
• Experience with stream processing (Apache Flink) and event/schema governance (CloudEvents, schema registry).
• Experience running stateful systems on Kubernetes (operators, persistent volumes, object/storage like MinIO/OpenEBS).
• Ability to define clean ownership boundaries and data/schema contracts with platform, trust, runtime, and delivery teams.

Responsibilities

• Own the memory and data stores across environments: relational and durable state, caching, vector stores, knowledge graphs, and object storage.
• Own event streaming and async messaging: Kafka, NATS JetStream, Debezium, Flink, and CloudEvents contracts.
• Own data durability, consistency, and recoverability: replication, backup/restore, and cross-environment data movement.
• Build and operate streaming and CDC pipelines with schema governance to prevent breaking changes.
• Make state multi-tenant and portable with isolation and performance across managed cloud and self-hosted OSS in multiple environments.
• Provide the data and lineage substrate that governance, observability, and AI capabilities depend on, and integrate with lineage tooling.

Skills

Production databases

Streaming systems

Kubernetes

Data durability

Automation / IaC

Data governance

Education

Bachelor’s or Master’s degree in Computer Science or related field

Tools

PostgreSQL

Redis

Qdrant

Milvus

PGVector

Neo4j

MinIO

OpenEBS

Kafka

Strimzi

NATS

Debezium

Flink

CloudEvents

Schema registry

Job description

EY seeks an AI Systems Engineer to own the stateful backbone of EY’s AI-native platform, spanning relational, vector, graph stores, and streaming pipelines across cloud, on-prem, edge, client-managed, and air-gapped environments.

You will ensure durability, consistency, and recoverability, build multi-tenant data substrates, and collaborate with teams to govern data lineage and schema contracts while advancing automation and IaC in regulated client contexts.