Data Engineer - Hybrid Kraków (Spark, Kafka, Hive)

Tesco Technology; Kraków; Hybrid; PLN 140,000 - 210,000; Full time

Benefits offered by this job

Yearly bonus 20%

Permanent contract

Private healthcare

Cafeteria & Multisport

4 extra paid leave days

25 days annual leave

Udemy learning platform

Back-to-school day

Fertility leave

Sports with trainer

Referral bonus

MacBook

Job summary

Tesco Technology in Kraków is hiring a Data Engineer to build and refine our data pipeline architecture and optimize data flow to support cross-functional teams.

You will collaborate with software developers, data scientists, and analysts to ensure scalable, secure data delivery across orders, suppliers, and products, while maintaining data integrity.

The role blends hands-on engineering with a passion for data-driven decision making, in a hybrid setup with office and remote work options.

Qualifications

• Proficient in Spark with Scala or Python.
• Experience with HDFS or CEPH S3 storage.
• Knowledge of YARN as resource manager.
• Familiar with Hive/Kyuubi lakehouse.
• Experience with Airflow or similar workflow scheduler.

Responsibilities

• Create and maintain optimal data pipeline architecture.
• Assemble large complex data sets to meet business requirements.
• Identify design and implement internal process improvements: automating manual processes and redesigning infrastructure for scalability.
• Build the infrastructure required for ETL from diverse data sources.
• Develop analytics tools using the data pipeline to provide actionable insights.
• Collaborate with stakeholders to assist data-related technical issues and support data infrastructure needs.
• Keep data separated and secure.
• Create data tools for analytics and data science teams.
• Work with data and analytics experts to enhance data system functionality.

Skills

Spark (Scala/Python)

HDFS/CEPH S3

YARN

Hive/Kyuubi

Airflow

Functional programming

Apache Kafka

Kubernetes

Stream processing

CI/CD

Job description

Tesco Technology in Kraków is hiring a Data Engineer to build and refine our data pipeline architecture and optimize data flow to support cross-functional teams.

You will collaborate with software developers, data scientists, and analysts to ensure scalable, secure data delivery across orders, suppliers, and products, while maintaining data integrity.

The role blends hands-on engineering with a passion for data-driven decision making, in a hybrid setup with office and remote work options.