Data Pipeline Architect - Scale Data for Smarter Logistics

TESCO POLAND; Kraków; Hybrid; PLN 180,000 - 240,000; Full time

Job summary

Tesco Poland is seeking a Data Engineer to expand and refine our data and data pipeline architecture. You will optimize data flow and collection to serve cross-functional teams, collaborating with software developers, DBAs, and data scientists on data-driven initiatives.

The role emphasizes building scalable data systems from the ground up, maintaining data integrity and security across high-volume order, delivery, and product data streams. Hybrid work model with on-site and remote collaboration.

Qualifications

• Data pipeline construction and optimization experience required.
• Experience with large-scale data processing ecosystems preferred.

Responsibilities

• Create and maintain optimal data pipeline architecture.
• Assemble large, complex data sets meeting business requirements.
• Automate manual data processes and redesign infrastructure for scalability.
• Build infrastructure for extraction, transformation, and loading from diverse sources.
• Develop analytics tools using the data pipeline to drive insights across teams.
• Collaborate with software engineers, DBAs, data analysts, and data scientists.
• Keep data secure and well-governed across projects.
• Develop data tools for analysts and data scientists to enhance product leadership.

Skills

Apache Spark

HDFS/CEPH S3

Apache Yarn

Hive/Kyuubi

Airflow

Job description

Tesco Poland is seeking a Data Engineer to expand and refine our data and data pipeline architecture. You will optimize data flow and collection to serve cross-functional teams, collaborating with software developers, DBAs, and data scientists on data-driven initiatives.

The role emphasizes building scalable data systems from the ground up, maintaining data integrity and security across high-volume order, delivery, and product data streams. Hybrid work model with on-site and remote collaboration.