Senior Data Engineer

Tenth Revolution Group; Scotland; Hybrid; GBP 59,000 - 70,000; Full time

Job summary

A leading retail company is seeking a Senior Data Engineer to help migrate to Microsoft Fabric. You will develop robust data pipelines and create a scalable data platform while coordinating with various teams to promote data-driven decisions. This hybrid role offers flexibility of working from home part of the week.

Benefits

Salary up to £70,000 depending on experience

24 days annual leave plus bank holidays

Company pension scheme

Private healthcare benefits

Qualifications

• Experience with Python/PySpark coding required.
• Data pipeline development using Azure Data Factory.
• Strong SQL knowledge essential.

Responsibilities

• Create a scalable data platform and integrate data sources.
• Develop robust data pipelines.
• Advise on best practices for data platform architecture.

Skills

Python

PySpark

SQL

Data pipeline development

Communication skills

Tools

Azure Data Factory

Lakehouse Architecture

Azure Synapse

Job description

Senior Data Engineer

I am looking for a Senior Data Engineer to join an established retailer as they look to migrate to Microsoft Fabric. They are looking to integrate a number of their data systems into one fully-scalable solution and create a brand-new data warehouse that will enable data to be readily available for reporting.

The business have office locations around the UK, however their technology hub is based just outside of Bristol and you would work collaboratively with the Engineering manager and other Engineers. You will also work collaboratively with the wider IT function to enable to organisation to leverage its data and orchestrate data-driven decisions.

As part of this role, you will be responsible for.

• Help create a scalable data platform and integrate data from various sources
• Create robust data pipelines
• Write robust code to transform and manipulate data
• Work with senior members of the technical team to advise on best practice of modern data platform architecture
• Contribute to the planning of the organisations long term data strategy, maintaining data integrity and a focus on GDPR at all times

To be successful in this role you will have.

• Coding experience with Python/PySpark
• Data pipeline development experience utilising Azure Data Factory or Fabric Pipelines
• Experience working within an Azure environment such as Lakehouse Architecture, Data Lake, Delta Lake, Azure Synapse
• Strong SQL knowledge
• Strong communication skills

This is a hybrid role based out of the organisations office in Bristol 3 times per week with the additional 2 days working from home.

Some of the benefits included in this role are.

• Salary up to £70,000 depending on experience
• 24 days annual leave plus bank holidays (rising to 27 days with service)
• Company pension scheme
• Healthcare benefits such as private healthcare

This is just a brief overview of the role. For the full information, simply apply to the role with your CV, and I will call you to discuss further. My client is looking to begin the interview process ASAP, so don't miss out, APPLY now!