Senior AI Systems Engineer – Stateful Data Platforms

EY; Buffalo (NY); Hybrid; USD 107,000 - 201,000; Full time

Benefits offered by this job

Medical and dental coverage

Pension and 401(k) plans

Paid time off

Job summary

EY seeks an AI Systems Engineer to own the stateful backbone of EY’s AI-native platform, spanning relational, vector, and object stores, plus streaming and CDC pipelines. You will ensure durability, consistency, and recoverability across cloud, on-prem, edge, and air-gapped environments.

The role demands deep expertise in production data infrastructure, multi-tenant design, and governance tooling, with a focus on reliability and automation to reduce toil.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or related technical field.
• 8+ years operating production data infrastructure, streaming systems, or database platforms at scale.
• Hands‑on expertise with PostgreSQL and caching (Redis/Valkey), including HA, replication, and backup/recovery.
• Exposure to AI/ML data patterns — embeddings, retrieval, feature/state stores for agentic workloads.
• Production experience with vector and/or graph databases (Qdrant, Milvus, PGVector, Neo4j) in AI/ML contexts.
• Deep experience with event streaming and messaging (Kafka/Strimzi, NATS) and change data capture (Debezium).
• Experience running stateful systems on Kubernetes (operators, persistent volumes, object/storage like MinIO/OpenEBS).
• Ability to define clean ownership boundaries and data/schema contracts with platform, trust, runtime, and delivery teams.

Responsibilities

• Own the memory and data stores: relational and durable state across environments.
• Own event streaming and async messaging systems and schema contracts.
• Own data durability, consistency, and recoverability across replicas and environments.
• Build and operate streaming and CDC pipelines with governance.
• Make state multi-tenant and portable, ensuring isolation and performance.
• Provide the data and lineage substrate for governance and AI capabilities.

Skills

Data infrastructure

Streaming systems

Kubernetes

Kafka

Debezium

Flink

Data durability

OpenLineage

Education

Bachelor’s or Master’s degree in Computer Science or related field

Tools

PostgreSQL

Redis/Valkey

Qdrant

Milvus

PGVector

Neo4j

MinIO

OpenEBS

Strimzi

Job description

EY seeks an AI Systems Engineer to own the stateful backbone of EY’s AI-native platform, spanning relational, vector, and object stores, plus streaming and CDC pipelines. You will ensure durability, consistency, and recoverability across cloud, on-prem, edge, and air-gapped environments.

The role demands deep expertise in production data infrastructure, multi-tenant design, and governance tooling, with a focus on reliability and automation to reduce toil.