Data Engineer

Matchtech; West of England; On-site; GBP 60,000 - 90,000; Full time

Benefits offered by this job

Azure training

Professional development

Modern cloud platforms

Collaborative environment

Job summary

Matchtech is seeking a Data Engineer to design and maintain scalable Azure data platforms, build robust data pipelines, and support data-driven solutions across the business.

You will work with Azure Data Factory, Databricks, Synapse, Data Lake Storage, and SQL databases, ensuring data quality, governance and CI/CD automation.

The role offers permanent employment in a leading technology organization with opportunities for Azure training and professional development.

Qualifications

• Bachelor's degree required in CS/IT/Data Engineering.
• Hands-on knowledge of Microsoft Azure data services.
• Experience with Azure Data Factory, Databricks and Synapse Analytics.
• Strong SQL development and performance tuning on Azure SQL databases.

Responsibilities

• Design, develop and maintain scalable data pipelines and integration solutions using Azure.
• Build and optimise ETL and ELT processes with Azure Data Factory, Databricks and Synapse Analytics.
• Manage and enhance data lakes, data warehouses and storage solutions, including Azure Data Lake Storage.
• Develop and optimise SQL queries, data models and database objects for performance and scalability.
• Ensure data quality, security, governance and compliance with organisational standards.
• Implement CI/CD practices and support deployment automation through Azure DevOps or GitHub.
• Monitor, troubleshoot and resolve data platform and pipeline issues.
• Collaborate with stakeholders, analysts and developers while maintaining technical documentation, data dictionaries and operational procedures.

Skills

Azure

SQL

Python

PySpark

Scala

Spark

Data Modeling

CI/CD

Data Governance

Databricks

Azure Data Factory

Azure Synapse

Azure Data Lake Storage

Azure SQL Database

SQL Server

Education

Bachelor's degree in Computer Science/IT/Data Engineering

Tools

Azure Data Factory

Azure Databricks

Azure Synapse Analytics

Azure Data Lake Storage

Azure SQL Database

SQL Server

Job description

Our client, a leading organisation within the technology sector, is seeking a Data Engineer to join its team on a permanent basis. The role will focus on designing and maintaining scalable Azure data platforms, developing robust data pipelines and supporting data-driven solutions across the business.

Key Responsibilities:

• Design, develop and maintain scalable data pipelines and integration solutions using Azure.
• Build and optimise ETL and ELT processes with Azure Data Factory, Databricks and Synapse Analytics.
• Manage and enhance data lakes, data warehouses and storage solutions, including Azure Data Lake Storage.
• Develop and optimise SQL queries, data models and database objects for performance and scalability.
• Ensure data quality, security, governance and compliance with organisational standards.
• Implement CI/CD practices and support deployment automation through Azure DevOps or GitHub.
• Monitor, troubleshoot and resolve data platform and pipeline issues.
• Collaborate with stakeholders, analysts and developers while maintaining technical documentation, data dictionaries and operational procedures.

Job Requirements:

• Experience in Data Engineering, database development or data integration, with hands‑on knowledge of Microsoft Azure data services.
• Strong experience with Azure Data Factory, Azure Databricks, Azure Synapse Analytics and Azure Data Lake Storage.
• Advanced SQL development and performance tuning skills, including experience with Azure SQL Database and SQL Server.
• Proficiency in Python, PySpark, Scala and Spark for data processing and distributed computing.
• Understanding of data warehousing concepts, dimensional modelling and ETL/ELT frameworks.
• Knowledge of data quality, data governance, metadata management and data security principles.
• Experience with CI/CD pipelines using Azure DevOps or GitHub, along with an understanding of cloud architecture.
• A bachelor's degree in Computer Science, Information Technology, Data Engineering or a related discipline; Microsoft Azure certifications such as DP-203 or AZ-900 would be advantageous.

Desirable Skills:

• Experience with Microsoft Fabric and Azure Database services.
• Knowledge of big data technologies, streaming solutions and modern data architecture patterns.
• Relevant Microsoft certification, such as Azure Data Engineer Associate, Azure Fundamentals or Azure Database Administrator Associate.

Benefits:

• Permanent opportunity within a forward‑thinking technology environment.
• Access to professional development and Microsoft Azure training opportunities.
• Opportunity to work with modern cloud data platforms and large‑scale data solutions.
• Collaborative working environment with opportunities to contribute to continuous improvement initiatives.