Azure Data Engineer: Build Scalable Cloud Pipelines

Scrumconnect Limited; Newcastle upon Tyne; On-site; GBP 55,000 - 75,000; Full time

Job summary

Scrumconnect Limited in Newcastle upon Tyne is seeking a proactive Azure Data Engineer to design, develop, and support scalable data solutions on Microsoft Azure. You will collaborate with engineering, data, and delivery teams to build reliable cloud data platforms and pipelines, while applying best practices for automation and source control.

The role emphasizes hands-on work with ADF, Synapse, Data Lake, and IaC with Terraform, alongside GitLab for CI/CD, and requires strong data engineering

Qualifications

• Experience designing and implementing scalable data pipelines in Azure.
• Hands-on experience with Azure Data Factory and Synapse Analytics.
• Strong knowledge of data lake storage and IaC with Terraform.
• Proficient in GitLab for CI/CD and source control.
• Ability to work with cross-functional teams and improve engineering practices.

Responsibilities

• Design, develop, and maintain scalable Azure data solutions and pipelines.
• Build data pipelines using Azure Data Factory.
• Develop data solutions with Azure Synapse Analytics.
• Manage data storage with Azure Data Lake.
• Implement cloud infrastructure using Terraform.
• Collaborate with developers, data analysts, architects, and delivery teams.
• Monitor and optimize data pipelines and Azure services.
• Ensure security, reliability, and maintainability of data solutions.
• Follow best practices around automation and source control.
• Use GitLab for CI/CD processes.

Skills

Data engineering

Data pipelines

Problem solving

Communication

Team collaboration

Automation mindset

Tools

Azure Data Factory

Azure Synapse Analytics

Azure Data Lake

Terraform

GitLab

GitLab CI/CD

Job description

Scrumconnect Limited in Newcastle upon Tyne is seeking a proactive Azure Data Engineer to design, develop, and support scalable data solutions on Microsoft Azure. You will collaborate with engineering, data, and delivery teams to build reliable cloud data platforms and pipelines, while applying best practices for automation and source control.

The role emphasizes hands-on work with ADF, Synapse, Data Lake, and IaC with Terraform, alongside GitLab for CI/CD, and requires strong data engineering