Data Engineer — Modern Pipelines & Automation (Hybrid)

Perch Group; Lancashire; Hybrid; GBP 40,000 - 45,000; Full time

Benefits offered by this job

Up to 20% bonus

Hybrid work

Blackpool office

Formal professional qualifications

Wellbeing & development

Job summary

Perch Group in the United Kingdom is seeking a Data Engineer to join our data platform team. You will build and maintain data pipelines using Azure Data Factory and Databricks, contributing to reusable pattern development and automated, governance‑aware delivery.

You will work with senior engineers to uplift data quality, modelling, and data warehouse layers while participating in CI/CD and DevOps practices.

Qualifications

• 3+ years T SQL including joins, transformations, stored procedures, and performance basics.
• 3+ years Azure Data Factory, including pipeline development, parameter usage, and basic templates.
• 3+ years Databricks experience (PySpark, Delta Lake, notebooks).
• 2+ years Python Experience
• Experience working with data warehouses and structured modelling concepts.
• Strong understanding of ETL/ELT practices and data centric engineering.
• Exposure to metadata driven or config driven engineering practices.
• Basic PySpark optimisation or Delta Lake performance tuning.
• Understanding of data governance, data quality tooling, or lineage concepts.
• Experience in regulated environments or financial services.

Responsibilities

• Build, maintain, and enhance data pipelines using Azure Data Factory, Databricks, Python and T SQL.
• Apply parameterisation, configuration, and reusable components in ADF and Databricks where appropriate.
• Support the creation of metadata driven patterns by implementing components and contributing to framework evolution.
• Assist in developing and refining data models and data warehouse layers.
• Ensure pipelines are performant, reliable, and aligned with engineering and governance standards.
• Work closely with senior engineers, analysts, and architects to understand requirements and deliver robust, well designed solutions.
• Contribute to code reviews, documentation, and quality improvement initiatives.
• Participate in DevOps practices such as CI/CD, automated testing, and version control.
• Troubleshoot and resolve pipeline issues, ensuring stability and data accuracy.
• Monitor pipeline performance and help implement improvements.
• Support continuous optimisation and lifecycle management.

Skills

T SQL

Azure Data Factory

Databricks

Python

Data Warehouses

ETL/ELT

Metadata/Config Driven Eng

Delta Lake / PySpark

Data Governance / Data Quality

Regulated Environments / FinServ

Tools

Azure Data Factory

Databricks

Delta Lake

PySpark

Job description

Perch Group in the United Kingdom is seeking a Data Engineer to join our data platform team. You will build and maintain data pipelines using Azure Data Factory and Databricks, contributing to reusable pattern development and automated, governance‑aware delivery.

You will work with senior engineers to uplift data quality, modelling, and data warehouse layers while participating in CI/CD and DevOps practices.