Azure Data Engineer

TXP; Birmingham; Remote; GBP 50,000 - 60,000; Full time

Job summary

A leading company is recruiting for a Data Engineer with expertise in Azure technologies to join a team focused on building a modern cloud-based data warehouse. The role involves significant responsibilities in developing ETL pipelines and ensuring data accuracy for essential reporting functions. The position offers a competitive salary and flexible working arrangements, with the potential for immediate start.

Qualifications

• Experience with Microsoft Fabric or Azure Synapse/Data Factory.
• Proficiency in PySpark, SQL, PL/SQL, and stored procedures.
• Familiarity with ERP systems like JDE, SAP, or Dynamics preferred.

Responsibilities

• Build ETL pipelines using Microsoft Fabric Data Factory.
• Perform data transformations, schema design, and cleansing.
• Validate data accuracy by comparing outputs to ERP source data.

Skills

Microsoft Fabric

PySpark

SQL

PL/SQL

Data Transformation

Job description

Role: Data Engineer (Azure)

Location: Remote working with occasional travel to Birmingham

Salary: 50,000- 60,000 per annum + benefits

We are currently recruiting for a Data Engineer to join the team and play a key role on a Data hub project, which is focused on building a modern cloud-based data warehouse, using Microsoft Fabric. The current priority is replacing the Global Data Warehouse (GDW), which supports sales and finance reporting. You will be working as part of a Data Engineering team and will play a significant role and be a key part of the project.

Role Responsibilities - you will:

• Focus on the Silver layer.
• Build ETL pipelines using Microsoft Fabric Data Factory.
• Perform data transformations, schema design, standardisation, and cleansing.
• Write PySpark notebooks and stored procedures with error tracking.
• Possibly assist with data dictionary and mapping logic in collaboration with the Data Warehouse Manager.
• Validate data accuracy by comparing outputs to ERP source data.

Skills and experience required:

• Microsoft Fabric (preferred), or Azure Synapse/Data Factory experience.
• PySpark, SQL, PL/SQL, stored procedures, error handling.
• Experience with ERP systems (e.g., JDE, SAP, Dynamics) is a nice-to-have.
• Familiarity with Oracle or DB2 is beneficial.
• Fabric certification is helpful but not essential-practical experience is more valued.
• Be eligible for SC Clearance

The client are looking for someone to start as early as August, please be aware of this if you have a lengthy notice period.

If you are interested in the role and would like to apply, please click on the link for immediate consideration.