Azure Data Engineer: Pipelines, Migration & Databricks

GIS Recruiter Ltd; England; On-site; GBP 65,000 - 100,000; Full time

Job summary

GIS Recruiter Ltd is seeking an experienced Data Engineer to support a data migration and integration programme within a developing Azure environment. The role focuses on designing and building robust data pipelines, migrating data from legacy systems, and delivering scalable data flows into Azure Data Lake and Databricks.

You will also help integrate data into a proprietary transformation solution and work closely with stakeholders to understand source data, target structures and transformation

Qualifications

• Experience designing data pipelines in Azure environments.
• Proven ability to migrate data from diverse legacy systems.
• Strong data transformation, mapping and validation skills.
• Experience with large-scale data migration and integration.

Responsibilities

• Design, build and maintain data migration and ingestion pipelines within Azure.
• Support the setup and development of the Azure Data Lake environment.
• Build integrations between source systems, Azure Data Lake and Databricks.
• Develop and manage pipelines using Azure Data Factory (ADF).
• Extract and migrate data from Oracle, Oracle Fusion, Informatica, SharePoint and other systems.
• Define scalable data ingestion, transformation and migration patterns for future sources.

Skills

Azure data engineering

Azure Data Factory

Building ETL/ELT pipelines

Data migration & integration

Data modeling & mapping

Data quality & validation

Tools

Azure Data Factory

Azure Data Lake

Databricks

Oracle

Oracle Fusion

Informatica

SharePoint

Job description

GIS Recruiter Ltd is seeking an experienced Data Engineer to support a data migration and integration programme within a developing Azure environment. The role focuses on designing and building robust data pipelines, migrating data from legacy systems, and delivering scalable data flows into Azure Data Lake and Databricks.

You will also help integrate data into a proprietary transformation solution and work closely with stakeholders to understand source data, target structures and transformation