Head of Real-Time Data Platform & AI Automation

Kraken; Peru (IL); On-site; USD 120,000 - 160,000; Full time

Job summary

Kraken is seeking a Data Platform Lead to manage its real-time streaming infrastructure. You will oversee the architecture of high-volume data systems and lead a team of engineers dedicated to transforming data in real time, driving automation through AI.

The ideal candidate has over 8 years of experience in data engineering, including expertise in platforms like Spark and Kafka. The role demands leadership skills and the ability to manage teams effectively.

Qualifications

• 8+ years in data engineering, platform engineering, or distributed systems, with at least 3 years managing teams.
• Experience building data-lakes in AWS, data modeling, data quality best practices.
• Strong expertise in real-time data at scale, including Kafka and Spark Streaming.

Responsibilities

• Lead a team of senior data platform engineers building real-time streaming infrastructure.
• Own the architecture and roadmap for high-volume data systems.
• Design and operate scalable data architecture serving multiple teams.

Skills

Data engineering experience

Platform engineering

Distributed systems

Cloud-native data infrastructure

Data Lakes in AWS

Real-time data systems

Proficiency in Python, Scala, or Java

Tools

Spark

Kafka

AWS Glue

Debezium

RisingWave

Job description

Kraken is seeking a Data Platform Lead to manage its real-time streaming infrastructure. You will oversee the architecture of high-volume data systems and lead a team of engineers dedicated to transforming data in real time, driving automation through AI.

The ideal candidate has over 8 years of experience in data engineering, including expertise in platforms like Spark and Kafka. The role demands leadership skills and the ability to manage teams effectively.