Hybrid Data Engineer: Clickstream & AI Pipelines

Allegro Sp. z o.o.; Warszawa; Hybrid; PLN 163,000 - 232,000; Full time

Benefits offered by this job

Flexible hybrid hours

30 days occasional remote work

MacBook Pro / Dell

Cafeteria benefits

English classes

Training budget

Volunteer day

Social events

Job summary

Allegro Sp. z o.o. in Warsaw is seeking a skilled Data Engineer to join the Vento team. You will design, scale, and maintain data validation pipelines for high-volume clickstream data, ensuring data quality before ingestion into core assets.

The role requires strong Python and Spark skills, familiarity with Scala, and collaboration with backend teams. Hybrid work with flexible hours and generous remote options are offered.

Qualifications

• Production experience in Big Data ecosystems and building stable data pipelines.
• Proficient in Python, Spark; Scala is a plus and alignment with Java backend apps.
• Understanding data quality, event contract validation, anomaly detection, and streaming data.
• Willingness to accept feedback, participate in code reviews, and develop skills.
• Proactive communicator with ownership and autonomy.
• Interest in how Big Data, Backend, and Frontend pillars interconnect.
• Enthusiasm for using AI coding tools to automate tasks and improve workflow.

Responsibilities

• Design, scale, develop, and maintain data validation pipelines for high-volume clickstream data in Vento service.
• Implement robust anomaly detection to ensure data integrity before core ingestion.
• Collaborate with cross-functional stakeholders to reconcile data requirements.
• Participate in engineering discussions, code reviews, and cross-team initiatives.

Skills

Python

Spark

Scala

Java backend

Data quality

Event contract validation

Anomaly detection

Code reviews

Autonomy

Cross-functional collaboration

Tools

Kubernetes

Docker

GitHub Actions

Consul

GitHub

Job description

Allegro Sp. z o.o. in Warsaw is seeking a skilled Data Engineer to join the Vento team. You will design, scale, and maintain data validation pipelines for high-volume clickstream data, ensuring data quality before ingestion into core assets.

The role requires strong Python and Spark skills, familiarity with Scala, and collaboration with backend teams. Hybrid work with flexible hours and generous remote options are offered.