Senior AI Data & State Systems Engineer

EY; Secaucus (NJ); Hybrid; USD 107,000 - 177,000; Full time

Job summary

EY is seeking an AI Systems Engineer to own the stateful backbone of EY’s AI-native platform across cloud, on-prem, edge, and air-gapped environments. You’ll manage relational/state stores, vector/graph stores, and durable workflows, ensuring durability, consistency, and recoverability.

You’ll lead streaming and CDC pipelines, enforce schema governance, and enable multi-tenant portability while collaborating with platform, trust, runtime, and delivery teams to minimize toil and maximize

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related technical field.
• 8+ years operating production data infrastructure, streaming systems, or database platforms at scale.
• Hands-on expertise with relational databases (PostgreSQL) and caching (Redis/Valkey), including HA, replication, and backup/recovery.
• Exposure to AI/ML data patterns — embeddings, retrieval, feature/state stores for agentic workloads.
• Production experience with vector and/or graph databases (Qdrant, Milvus, PGVector, Neo4j) in AI/ML contexts.
• Deep experience with event streaming and messaging (Apache Kafka/Strimzi, NATS) and change data capture (Debezium).
• Experience with stream processing (Apache Flink) and event/schema governance (CloudEvents, schema registry).
• Experience running stateful systems on Kubernetes (operators, persistent volumes, object/storage such as MinIO/OpenEBS).
• Ability to define clean ownership boundaries and data/schema contracts with platform teams.

Responsibilities

• Own the memory and data stores: relational and durable state (PostgreSQL, DBOS), caching (Redis/Valkey), vector stores (Qdrant/Milvus/PGVector), knowledge graphs (Neo4j), and object/storage across environments.
• Own event streaming and async messaging: Kafka (Strimzi), NATS JetStream, Debezium, Flink, and CloudEvents.
• Own data durability, consistency, and recoverability: replication, backup/restore, point-in-time recovery, cross-environment data movement.
• Build and operate streaming and CDC pipelines moving data reliably between stores and services with schema governance.
• Make state multi-tenant and portable with isolation and performance guarantees across cloud and on-prem environments.
• Provide the data and lineage substrate for governance, observability, and AI knowledge capabilities, integrating with lineage tooling.

Skills

Data infrastructure

Streaming architectures

Reliability mindset

Multi-environment ops

Education

Bachelor’s or Master’s degree in Computer Science or related field

Tools

PostgreSQL

Redis/Valkey

Qdrant/Milvus/PGVector

Neo4j

MinIO/OpenEBS

Apache Kafka

Strimzi/NATS

Debezium

Apache Flink

CloudEvents/Schema registry

OpenLineage/Marquez

Temporal

Job description

EY is seeking an AI Systems Engineer to own the stateful backbone of EY’s AI-native platform across cloud, on-prem, edge, and air-gapped environments. You’ll manage relational/state stores, vector/graph stores, and durable workflows, ensuring durability, consistency, and recoverability.

You’ll lead streaming and CDC pipelines, enforce schema governance, and enable multi-tenant portability while collaborating with platform, trust, runtime, and delivery teams to minimize toil and maximize