Azure Data Engineer: Data Pipelines, Lake & Migration

GIS Recruiter Ltd; Tyseley; On-site; GBP 65,000 - 90,000; Full time

Job summary

GIS Recruiter Ltd is seeking an experienced Data Engineer to support a data migration and integration programme within a relatively low maturity Azure environment. You will design, build and maintain data migration and ingestion pipelines in Azure, and help establish scalable data flows into Azure Data Lake and Databricks.

Key responsibilities include integrating data from Oracle, Oracle Fusion, Informatica and SharePoint sources, developing pipelines with ADF, and partnering with stakeholders

Qualifications

• Azure Data Factory, Azure Data Lake and Databricks experience.
• Experience designing and building robust data pipelines.
• Migration of data from legacy and enterprise sources.

Responsibilities

• Design, build and maintain data migration and ingestion pipelines in Azure.
• Support the setup of the Azure Data Lake environment.
• Build integrations between source systems, Azure Data Lake and Databricks.
• Develop and manage pipelines using Azure Data Factory (ADF).
• Extract and migrate data from Oracle, Oracle Fusion, Informatica and SharePoint.
• Define scalable data ingestion, transformation and migration patterns.
• Support data quality, validation and troubleshooting during migration.
• Collaborate with stakeholders to understand sources and transformation needs.
• Improve maturity of the Azure data environment with best practices.

Skills

Azure Data Factory

Azure Data Lake

Databricks

ETL pipelines

Data migration

Data integration

Oracle sources

SharePoint data

Data transformation

Source-to-target mapping

Job description

GIS Recruiter Ltd is seeking an experienced Data Engineer to support a data migration and integration programme within a relatively low maturity Azure environment. You will design, build and maintain data migration and ingestion pipelines in Azure, and help establish scalable data flows into Azure Data Lake and Databricks.

Key responsibilities include integrating data from Oracle, Oracle Fusion, Informatica and SharePoint sources, developing pipelines with ADF, and partnering with stakeholders