Senior AI Systems Engineer — Stateful Data Platform

EY; Boca Raton (FL); Hybrid; USD 107,000 - 177,000; Full time

Benefits offered by this job

Hybrid work model

Total Rewards package

Generous paid time off

Job summary

EY seeks an AI Systems Engineer to own the stateful backbone of EY’s AI‑native platform, including data stores, memory tiers, and event streaming, across cloud, on‑prem, edge, and air‑gapped environments.

You’ll manage relational, vector, and graph stores, streaming pipelines, and durable workflows to ensure data durability, consistency, and recoverability in regulated client contexts.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related technical field.
• 8+ years operating production data infrastructure, streaming systems, or database platforms at scale.
• Hands‑on expertise with relational databases (PostgreSQL) and caching (Redis/Valkey), including HA, replication, and backup/recovery.
• Exposure to AI/ML data patterns — embeddings, retrieval, feature/state stores for agentic workloads.
• Production experience with vector and/or graph databases (Qdrant, Milvus, PGVector, Neo4j) in AI/ML contexts.
• Deep experience with event streaming and messaging (Apache Kafka/Strimzi, NATS) and change data capture (Debezium).
• Experience with stream processing (Apache Flink) and event/schema governance (CloudEvents, schema registry).
• Experience running stateful systems on Kubernetes (operators, persistent volumes, object/storage like MinIO/OpenEBS).
• Ability to define clean ownership boundaries and data/schema contracts with platform, trust, runtime, and delivery teams.

Responsibilities

• Own memory and data stores: relational and durable state (PostgreSQL, DBOS durable workflows), caching (Redis/Valkey), vector stores, knowledge graphs, and object storage.
• Own event streaming and async messaging: Kafka, NATS JetStream, Debezium, Flink, and CloudEvents/schema contracts.
• Own data durability, consistency, and recoverability: replication, backup/restore, PITR, cross‑environment data movement.
• Build and operate streaming and CDC pipelines with schema governance and evolution.
• Make state multi‑tenant and portable, ensuring isolation and performance across environments.
• Provide data and lineage substrate for downstream governance, observability, and AI knowledge capabilities.

Skills

Production databases

Streaming architectures

Durability mindset

Multi-tenant data

Schema governance

Effective communicator

Automation & IaC

Education

Bachelor’s or Master’s in CS or related

Tools

PostgreSQL

Redis/Valkey

Qdrant/Milvus/PGVector

Neo4j

MinIO/OpenEBS

Kafka

NATS

Debezium

Flink

CloudEvents/Schema Registry

Kubernetes

Job description

EY seeks an AI Systems Engineer to own the stateful backbone of EY’s AI‑native platform, including data stores, memory tiers, and event streaming, across cloud, on‑prem, edge, and air‑gapped environments.

You’ll manage relational, vector, and graph stores, streaming pipelines, and durable workflows to ensure data durability, consistency, and recoverability in regulated client contexts.