Senior AI Data Infrastructure Engineer

EY; Philadelphia (Philadelphia County); Hybrid; USD 107,000 - 177,000; Full time

Benefits offered by this job

Hybrid work model

Total Rewards package

Paid time off

Job summary

EY is seeking an AI Systems Engineer to own the stateful backbone of EY’s AI-native platform, including data stores, memory tiers, and event streaming systems across cloud, on-prem, edge, and air-gapped environments.

This role focuses on durable, consistent access to data for agentic AI workloads, ensuring reliability, scalability, and multi-tenant isolation in regulated client contexts.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related technical field.
• 8+ years operating production data infrastructure, streaming systems, or database platforms at scale.
• Hands-on expertise with PostgreSQL and caching (Redis/Valkey), including HA, replication, and backup/recovery.
• Exposure to AI/ML data patterns with embeddings, retrieval, feature/state stores for agentic workloads.
• Production experience with vector/graph databases (Qdrant, Milvus, PGVector, Neo4j).
• Experience with event streaming and messaging (Kafka/Strimzi, NATS) and change data capture (Debezium).
• Experience with stream processing (Flink) and governance (CloudEvents, schema registry).
• Experience running stateful systems on Kubernetes (operators, persistent volumes, MinIO/OpenEBS).
• Ability to define clean ownership boundaries and data/schema contracts.

Responsibilities

• Own memory and data stores across environments and tenants including relational, vector, and object storage.
• Own event streaming and async messaging with Kafka, NATS, Debezium, Flink, and CloudEvents.
• Ensure data durability, consistency, recoverability, and cross-environment data movement with RPO/RTO considerations.
• Build and operate streaming and CDC pipelines with schema governance to prevent breaking changes.
• Make state multi-tenant and portable with proper isolation and performance.
• Provide data and lineage substrate for governance, observability, and AI knowledge capabilities.

Skills

Production databases

Streaming architectures

Kubernetes

Data durability

Schema governance

Education

Bachelor’s or Master’s degree in Computer Science or related field

Tools

PostgreSQL

Redis/Valkey

Qdrant

Milvus

PGVector

Neo4j

MinIO

OpenEBS

Kafka

Strimzi

NATS

Debezium

Flink

CloudEvents

Temporal

OpenLineage

Marquez

MirrorMaker

Job description

EY is seeking an AI Systems Engineer to own the stateful backbone of EY’s AI-native platform, including data stores, memory tiers, and event streaming systems across cloud, on-prem, edge, and air-gapped environments.

This role focuses on durable, consistent access to data for agentic AI workloads, ensuring reliability, scalability, and multi-tenant isolation in regulated client contexts.