Senior AI Data Systems Engineer - Stateful Platform

EY; Los Angeles (CA); On-site; USD 107,000 - 177,000; Full time

Job summary

EY is seeking an AI Systems Engineer to own the stateful backbone of EY’s AI-native platform, covering databases, memory tiers, and event streaming across cloud, on-prem, edge, and air-gapped environments. This role focuses on durable, consistent data access for agentic workloads and tight coupling with governance and lineage tooling.

The ideal candidate will manage relational, key-value, vector, and graph stores, ensure data durability, and build robust CDC pipelines.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related field.
• 8+ years operating production data infrastructure, streaming systems, or database platforms at scale.
• Hands-on expertise with PostgreSQL and caching (Redis/Valkey), including HA, replication, and backup/recovery.
• Exposure to AI/ML data patterns — embeddings, retrieval, feature/state stores for agentic workloads.
• Production experience with vector and/or graph databases (Qdrant, Milvus, PGVector, Neo4j).
• Deep experience with event streaming and messaging (Kafka/Strimzi, NATS) and change data capture (Debezium).
• Experience with stream processing (Flink) and event/schema governance (CloudEvents, registry).
• Experience running stateful systems on Kubernetes (operators, persistent volumes, MinIO/OpenEBS).
• Ability to define clean data ownership boundaries and schema contracts with multiple teams.

Responsibilities

• Own the memory and data stores across environments (PostgreSQL, Redis, vector stores, graph stores, object storage).
• Own event streaming and async messaging (Kafka, NATS JetStream, Debezium, Flink).
• Own data durability, consistency, recoverability, and cross-environment movement (backup/restore, PITR).
• Build and operate streaming and CDC pipelines with schema governance to prevent breaking changes.
• Make state multi-tenant and portable with isolation and performance guarantees across clouds and air-gapped OSS.
• Provide data and lineage substrate for governance, observability, and AI knowledge capabilities.

Skills

Data Infra

Streaming Arch

Durability Mindset

Multi-env Ops

Schema Governance

Ownership Boundaries

Automation IaC

Education

CS Degree

Tools

PostgreSQL

Redis

Qdrant

Milvus

PGVector

Neo4j

MinIO

OpenEBS

Kafka

Strimzi

NATS

Debezium

Flink

CloudEvents

Schema Registry

Job description

EY is seeking an AI Systems Engineer to own the stateful backbone of EY’s AI-native platform, covering databases, memory tiers, and event streaming across cloud, on-prem, edge, and air-gapped environments. This role focuses on durable, consistent data access for agentic workloads and tight coupling with governance and lineage tooling.

The ideal candidate will manage relational, key-value, vector, and graph stores, ensure data durability, and build robust CDC pipelines.