Lead Stateful AI Data Platform Engineer

EY; Boston (MA); Hybrid; USD 107,000 - 177,000; Full time

Benefits offered by this job

Hybrid work model

Total rewards package including health

Job summary

EY seeks an AI Systems Engineer to own the stateful backbone of EY’s AI-native platform across cloud, on-prem, edge, and air-gapped environments. You will manage relational, vector, and graph stores, and streaming pipelines to ensure durable, reliable access for agentic AI workloads.

You will drive data durability, schema governance, and cross-environment data movement, enabling governance, observability, and AI knowledge capabilities with strong automation and IaC practices.

Qualifications

• 8+ years operating production data infrastructure, streaming systems, or database platforms at scale.
• Hands-on with PostgreSQL and caching (Redis/Valkey), including HA, replication, and backup/recovery.
• Exposure to AI/ML data patterns — embeddings, retrieval, feature/state stores.
• Experience with vector/graph databases (Qdrant, Milvus, PGVector, Neo4j) in AI contexts.
• Event streaming and messaging (Kafka/Strimzi, NATS) and change data capture (Debezium).
• Stream processing (Flink) and event/schema governance (CloudEvents, schema registry).

Responsibilities

• Own the memory and data stores across environments and tenants.
• Own event streaming and async messaging with Kafka, NATS JetStream, Debezium.
• Ensure data durability, consistency, and recoverability with backups and PITR.
• Build streaming and CDC pipelines with schema governance across producers/consumers.
• Make state multi-tenant and portable with isolation and performance guarantees.
• Provide data and lineage substrate for governance, observability, and AI capabilities.

Skills

Data infrastructure

Streaming architectures

Reliability mindset

Cloud & on-prem

Education

Bachelor’s or Master’s degree in Computer Science

Tools

PostgreSQL

Redis

Qdrant

Milvus

Neo4j

MinIO

OpenEBS

Kafka

NATS

Debezium

Flink

Job description

EY seeks an AI Systems Engineer to own the stateful backbone of EY’s AI-native platform across cloud, on-prem, edge, and air-gapped environments. You will manage relational, vector, and graph stores, and streaming pipelines to ensure durable, reliable access for agentic AI workloads.

You will drive data durability, schema governance, and cross-environment data movement, enabling governance, observability, and AI knowledge capabilities with strong automation and IaC practices.