Senior Data Engineer - Agents Systems

Kraken; United States; Remote; USD 140,000 - 190,000; Full time

Job summary

Kraken seeks a Senior Data Engineer to build and optimize AI-powered data pipelines and streaming systems. You will design scalable real-time data architecture to support live inference and model serving.

You will collaborate with ML engineers and AI infrastructure teams to define data contracts, ensure data quality, observability, and reliability in a fast-paced production environment.

Qualifications

• Experience designing and building streaming data pipelines.
• Strong knowledge of data quality, observability, and reliability.
• Ability to collaborate with ML engineers and AI infra teams.

Responsibilities

• Design and optimize AI-powered data pipelines for real-time inference.
• Build scalable streaming architectures with low latency and high reliability.
• Partner with ML/AI teams to define data contracts and feature schemas.

Skills

Streaming data

Real-time processing

Tools

Kafka

Spark

Airflow

Job description

Kraken seeks a Senior Data Engineer to enhance internal systems by building AI-powered agents and optimizing data pipelines. Ideal candidates have extensive experience in streaming systems and data engineering.

As a Senior Data Engineer at Kraken, you will be part of the Agent Systems team, responsible for developing AI-driven agents that automate processes and improve real-time data handling. Your work will focus on building and maintaining streaming data pipelines that support live inference and model serving, ensuring high reliability and low latency.

This role requires collaboration with ML engineers and AI infrastructure teams to establish data contracts and feature schemas. You will be expected to drive the evolution of data pipelines from batch processing to real‑time execution, ensuring data quality and observability throughout. The environment is fast‑paced, demanding both experimentation and production readiness.