Data Platform Engineer: Clickstream & AI-Ready Pipelines

Allegro Sp. z o.o.; Warszawa; Hybrid; PLN 15,000 - 21,000; Full time

Benefits offered by this job

Flexible hours

Hybrid work model

30 days remote work

MacBook Pro / Dell laptop

Cafeteria benefits

English classes

Volunteer day off

Team events

Job summary

Allegro Sp. z o.o. in Warsaw is seeking a skilled Data Engineer to join the Vento team, focusing on standardizing and validating clickstream events and ensuring data quality for AI agents and dashboards.

You will design and maintain high-volume data pipelines using Python and Spark, work with data quality, and collaborate across teams in a hybrid role. The company offers a rich benefits package and opportunities to grow in a data-driven environment.

Qualifications

• Production-proven experience in Big Data ecosystems and building stable data pipelines.
• Proficiency in Python; Spark experience; Scala is a plus.
• Understanding data quality, event contract validation, and anomaly detection in streaming environments (Clickstream).
• Proactive communicator, capable of code reviews and autonomous task ownership.

Responsibilities

• Design, scale, develop, and maintain data validation pipelines for high-volume clickstream data in the Vento service.
• Implement robust anomaly detection to ensure data integrity before ingestion into core data assets.
• Collaborate with cross-functional stakeholders to reconcile data requirements.
• Participate in engineering discussions, code reviews, and cross-team initiatives.

Skills

Python

Spark

Scala

Big Data

Tools

Kubernetes

Docker

Consul

GitHub

GitHub Actions

Job description

Allegro Sp. z o.o. in Warsaw is seeking a skilled Data Engineer to join the Vento team, focusing on standardizing and validating clickstream events and ensuring data quality for AI agents and dashboards.

You will design and maintain high-volume data pipelines using Python and Spark, work with data quality, and collaborate across teams in a hybrid role. The company offers a rich benefits package and opportunities to grow in a data-driven environment.