Data Platform Engineer: Clickstream & AI Pipelines

Allegro Ltd.; Województwo wielkopolskie; Ibrido; PLN 180.000 - 240.000; Tempo pieno

Vantaggi offerti da questo lavoro

Hybrid work model

Modern offices and equipment

Cafeteria benefits plan

English classes

Training budget

Volunteer day

Social events

Descrizione del lavoro

Allegro Ltd. is seeking a skilled Data Engineer to join the Vento team in Poland. You will design and scale data validation pipelines for high-volume clickstream data and ensure data integrity for AI agents and dashboards.

You will work with Python, Spark, and Java backend systems, contribute to data quality, event contracts, and anomaly detection, and participate in code reviews and cross-team initiatives. Hybrid model with flexible hours and ample learning opportunities await.

Competenze

• Production-proven experience in Big Data ecosystems and building data pipelines.
• Proficient in Python and Spark; Scala is a plus; comfortable with Java backend apps.
• Understanding data quality, event contract validation, anomaly detection, streaming data (Clickstream).
• Willing to participate in code reviews and develop skills.
• Proactive communicator with ownership and autonomy.
• Interested in how Big Data, Backend, and Frontend connect.
• Open to using AI coding tools to automate tasks.
• Polish at least C1 and English at least B2.

Mansioni

• Design, scale, develop, and maintain data validation pipelines for high-volume clickstream data in Vento.
• Implement robust anomaly detection to ensure data integrity before ingestion into Data Assets.
• Collaborate with cross-functional stakeholders to reconcile data requirements.
• Participate in engineering discussions, code reviews, and cross-team initiatives.

Conoscenze

Big Data

Python

Spark

Scala

Java backend

Data quality

Event contracts

Anomaly detection

Streaming

Clickstream

Code reviews

AI tools

Polish (C1)

English (B2)

Strumenti

Kubernetes

Docker

GitHub

GitHub Actions

Descrizione del lavoro

Allegro Ltd. is seeking a skilled Data Engineer to join the Vento team in Poland. You will design and scale data validation pipelines for high-volume clickstream data and ensure data integrity for AI agents and dashboards.

You will work with Python, Spark, and Java backend systems, contribute to data quality, event contracts, and anomaly detection, and participate in code reviews and cross-team initiatives. Hybrid model with flexible hours and ample learning opportunities await.