Data Engineer (Fulfillment)

Tesco Poland; Kraków; On-site; PLN 167,400 - 223,200; Full time

Benefits offered by this job

Flexible remote work

Inclusive environment

Opportunities for professional development

Job summary

Tesco Poland is looking for a skilled Data Engineer to join their Data Engineering department in Kraków. This role involves expanding and refining data pipelines and optimizing data flow across teams.

The ideal candidate will work collaboratively with developers and analysts while ensuring data integrity and security. Tesco emphasizes a balance between remote and in-office work, supporting diversity and inclusion in their recruitment process.

Join Tesco to help shape the future of their data operations and make a positive impact daily!

Qualifications

• Experience in building data pipeline architecture.
• Ability to optimize and automate manual processes.
• Strong knowledge of data security and integrity.

Responsibilities

• Create and maintain data pipeline architecture.
• Assemble complex data sets for business requirements.
• Identify design and implement internal process improvements.
• Build infrastructure for optimal extraction and transformation of data.
• Develop analytics tools for actionable insights.

Skills

Data Processing: Apache Spark - Scala or Python

Data Storage: Apache HDFS, CEPH S3

Resource Manager: Apache Yarn

Lakehouse: Apache Hive/Kyuubi

Workflow Scheduler: Airflow

Tools

Apache Kafka

Kubernetes

Stream processing

CI/CD

Job description

Overview

The Data Engineering department at Tesco Technology is at the forefront of data processing within the retail and technology industry. This vital department handles a range of responsibilities, including:

• Analyzing order and delivery data to optimize logistics processes and enhance delivery efficiency.
• Managing critical data related to customer orders, suppliers, and products to ensure the seamless flow of our fulfillment operations.
• Upholding data integrity and security during the processing of order and delivery-related information.

As we continue to expand, we are actively seeking a skilled Data Engineer to join our team of analytics experts. In this role, you will take charge of expanding and refining our data and data pipeline architecture. Additionally, you will be instrumental in optimizing data flow and collection to cater to the needs of cross-functional teams.

Our ideal candidate is an experienced data pipeline builder and data enthusiast who relishes the opportunity to optimize data systems and construct them from the ground up. As a Data Engineer, you will collaborate closely with software developers, database architects, data analysts, and data scientists on various data-driven initiatives. You will play a crucial role in ensuring that the optimal data delivery architecture remains consistent across all ongoing projects.

This role calls for a high level of self-direction and the ability to effectively support the data requirements of multiple teams, systems, and products. If you are enthusiastic about the prospect of optimizing, and possibly even redesigning, our company's data architecture to support our next generation of products and data initiatives, we encourage you to apply and be part of our dynamic team shaping the future of our data operations!

Responsibilities

• Creating and maintaining optimal data pipeline architecture
• Assembling large, complex data sets that meet functional / non-functional business requirements
• Identifying design and implementing internal process improvements: automating manual processes, optimising data delivery, re-designing infrastructure for greater scalability
• Building the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources
• Building analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics
• Working with stakeholders, including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs
• Keeping our data separated and secure
• Creating data tools for analytics and data science team members that assist them in building and optimising our product into an innovative industry leader
• Working with data and analytics experts to strive for greater functionality in our data systems

Mandatory skills

• Data Processing: Apache Spark - Scala or Python
• Data Storage: Apache HDFS, CEPH S3 or respective cloud alternative
• Resource Manager: Apache Yarn or respective cloud alternative
• Lakehouse: Apache Hive/Kyuubi or alternative
• Workflow Scheduler: Airflow or alternative

Nice to have skills

• Functional programming
• Apache Kafka
• Kubernetes
• Stream processing
• CI/CD

Unsure if you fit all the criteria? Apply and give us the chance to evaluate your potential – you could be the perfect fit!

Culture and benefits

Our colleagues work with one goal in mind, helping to make every day a little better for our customers, colleagues and communities all over the world. No two customers are the same, neither are our colleagues.

At Tesco, we champion a balance that lets you thrive both in and out of work. Spend 60% of your week collaborating with colleagues at our office locations or local sites and the rest remotely. Whether you're just kicking off your career, juggling passions, or navigating big life events, we're here to support you.

Tesco is committed to celebrating diversity and everyone is welcome at Tesco. As a Disability Confident Employer, we’re committed to providing a fully inclusive and accessible recruitment process, allowing candidates the opportunity to thrive and inform us of any reasonable adjustments they may require.

Want to get to know us better? The following would normally provide more insight into our culture, but this description has no external links.

What our colleagues like the most at Tesco:

• We develop our own products
• We make an impact; large scale of operation
• Accountability and respect are given to us
• We cooperate and support each other
• There are great colleagues who are divided into small teams here
• We can develop and learn new things