Azure Data Engineer - Data Migration and ETL

GIS Recruiter Ltd; Birmingham; On-site; GBP 65,000 - 90,000; Full time

Job summary

GIS Recruiter Ltd is seeking an experienced Data Engineer to support a data migration and integration programme within a relatively low maturity Azure environment.

You will design, build and maintain data migration and ingestion pipelines, support the Azure Data Lake, and create integrations between source systems, Azure Data Lake and Databricks. Collaboration with stakeholders will shape data transformation and validation requirements.

Qualifications

• Experience designing and building Azure data pipelines and data engineering solutions.
• Experience with Azure Data Factory (ADF) and Azure Data Lake.
• Experience with Databricks and large-scale data migration projects.
• Experience extracting and integrating data from Oracle/Oracle Fusion and SharePoint sources.

Responsibilities

• Design, build and maintain data migration and ingestion pipelines within Azure.
• Support the setup and development of the Azure Data Lake environment.
• Build integrations between source systems, Azure Data Lake and Databricks.
• Develop and manage pipelines using Azure Data Factory (ADF).
• Extract and migrate data from multiple source systems including Oracle, Oracle Fusion, Informatica and SharePoint.
• Define scalable data ingestion, transformation and migration patterns for future sources.
• Support data quality, validation and troubleshooting throughout the migration.
• Close collaboration with technical and business stakeholders to understand data and transformation needs.
• Help improve the Azure data environment by introducing engineering standards and best practices.

Skills

Azure Data Engineering

ETL/ELT pipelines

Large-scale data migration

Data transformation and mapping

Data validation

Stakeholder collaboration

Tools

Azure Data Factory (ADF)

Azure Data Lake

Databricks

Oracle/Oracle Fusion

SharePoint data extraction

Informatica

Job description

GIS Recruiter Ltd is seeking an experienced Data Engineer to support a data migration and integration programme within a relatively low maturity Azure environment.

You will design, build and maintain data migration and ingestion pipelines, support the Azure Data Lake, and create integrations between source systems, Azure Data Lake and Databricks. Collaboration with stakeholders will shape data transformation and validation requirements.