Senior Data Engineer

Perch Group

Lancashire

Hybrid

GBP 59,000 - 72,000

Full time

10 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Annual bonus up to 20%
Hybrid work at Blackpool office
Flexible working hours

Job summary

Perch Group is recruiting a Senior Data Engineer to lead the evolution of our data platform. You will design metadata-driven patterns, build reusable components, and set automation standards to accelerate delivery and improve quality.

You will own end-to-end data ingestion, transformation, and publishing using ADF, Databricks, and T-SQL, while maturing the enterprise data warehouse and enforcing governance. Hybrid work from our Blackpool office is available.

Qualifications

  • 5+ years advanced T-SQL with strong optimisation, dynamic SQL, and engineering-oriented design patterns.
  • 5+ years ADF: parameterisation, custom frameworks, and template-based orchestration.
  • 5+ years Databricks including PySpark optimisation, Delta Lake architecture, and DABs.
  • Demonstrable experience building metadata-driven or config-driven frameworks — not just talking about them.
  • 5+ years data modelling, including designing dimensional models that support enterprise-scale consumption.
  • End-to-end delivery experience across data warehouse or data platform programmes.
  • Experience with dynamic schema detection, inferred metadata processing, or multi-tenant ingestion patterns.
  • Advanced orchestration approaches (Databricks Workflows, Functions, event-driven patterns).
  • Practical CI/CD experience using Azure DevOps for data engineering (not just familiarity).
  • Experience in regulated industries where quality, lineage, and governance matter.
  • Understanding of data management frameworks (DAMA, DCAM, etc.).

Responsibilities

  • Design and implement metadata-driven and config-driven frameworks that replace one-off pipelines with reusable, scalable patterns.
  • Develop templates, orchestration patterns, and reusable components that minimise manual engineering effort.
  • Introduce engineering standards that prioritise automation, maintainability, and lifecycle governance.
  • Build and optimise robust ingestion, transformation, and publishing pipelines using ADF, Databricks (PySpark/Delta Lake) and T-SQL — with automation principles embedded from the start.
  • Assist in maturing the enterprise data warehouse architecture and data models.
  • Ensure all designs align with best practices around performance, optimisation, logging, monitoring, and quality.
  • Partner with architects and product teams to identify high-value automation opportunities.
  • Mentor engineers and uplift engineering discipline through coaching, patterns, and code reviews.
  • Strengthen DevOps, CI/CD, and automated testing approaches for data workloads.

Skills

T-SQL expertise
ADF experience
Databricks PySpark
Data modelling
End-to-end data delivery
Metadata-driven frameworks

Tools

Azure DevOps
Databricks
Delta Lake

Job description

Perch are recruiting for a Senior Data Engineer.

At Perch Group, our vision is clear: to lead the UK debt purchase and collection industry by harnessing cutting-edge technology to drive ethical, efficient, and data-driven debt resolution.

Our annual mission is to empower hundreds of thousands of customers to positively engage with and resolve their outstanding debts. We do this through an empathetic and customer-centric approach that is at the heart of our success.

Could this be the next step in your career?

We’re hiring a Senior Data Engineer to drive the next evolution of our data platform by introducing metadata-driven, configurable, and repeatable engineering frameworks. This role is for someone who has outgrown building pipelines one at a time and is ready to industrialise how a modern data platform operates.

Your focus will be on designing patterns, frameworks, and automation that fundamentally change our speed and quality of delivery. This is an engineering leadership position for someone who can solve problems at the framework and architecture level.

So, what will your day-to-day look like?
  • Design and implement metadata-driven and config-driven frameworks that replace one-off pipelines with reusable, scalable patterns.
  • Develop templates, orchestration patterns, and reusable components that minimise manual engineering effort.
  • Introduce engineering standards that prioritise automation, maintainability, and lifecycle governance.
Core Engineering Delivery
  • Build and optimise robust ingestion, transformation, and publishing pipelines using ADF, Databricks (PySpark/Delta Lake) and T-SQL — with automation principles embedded from the start.
  • Assist in maturing the enterprise data warehouse architecture and data models.
  • Ensure all designs align with best practices around performance, optimisation, logging, monitoring, and quality.
  • Partner with architects and product teams to identify high-value automation opportunities.
  • Mentor engineers and uplift engineering discipline through coaching, patterns, and code reviews.
  • Strengthen DevOps, CI/CD, and automated testing approaches for data workloads.
Does this sound like you?

We are looking for depth, not surface-level exposure. Please apply only if you have hands-on experience in the following:

  • 5+ years advanced T-SQL with strong optimisation, dynamic SQL, and engineering-oriented design patterns.
  • 5+ years ADF: parameterisation, custom frameworks, and template-based orchestration (not just building pipelines).
  • 5+ years Databricks including PySpark optimisation, Delta Lake architecture, and DABs
  • Demonstrable experience building metadata-driven or config-driven frameworks — not just talking about them.
  • 5+ years data modelling, including designing dimensional models that support enterprise-scale consumption.
  • End-to-end delivery experience across data warehouse or data platform programmes.
  • Experience with dynamic schema detection, inferred metadata processing, or multi-tenant ingestion patterns.
  • Advanced orchestration approaches (Databricks Workflows, Functions, event-driven patterns).
  • Practical CI/CD experience using Azure DevOps for data engineering (not just familiarity).
  • Experience in regulated industries where quality, lineage, and governance matter.
  • Understanding of data management frameworks (DAMA, DCAM, etc.).
The Application Timeline
  • A first stage video call with the internal recruitment team (15 minutes)
  • A SQL and ADF technical test either in person or over Zoom (up to 2 hours)
  • A face-to-face interview with the hiring manager (1 hour)

If you do not receive a response after 3 weeks of applying, please assume you have been unsuccessful as we may experience a high volume of applications.

Why you should be EXCITED to apply…
  • £65,000+ up to 20% of your annual salary, paid as a bonus.
  • This role is hybrid and based at ourBlackpooloffice.
  • 37.5 hoursper week. We offer flexible andhybridworking between our core hours of 8am- 6pm, Monday to Friday.
  • The opportunity to completeformal qualificationsand learn on the job in a successful, growing organisation.
  • And many more benefits to support your wellbeing and professional development.

We’re an equal opportunity employer. All applicants will be considered for employment without attention to age, ethnicity, religion, sex, sexual orientation, gender identity, family or parental status, national origin, or veteran, neurodiversity or disability status.

If you have any questions or suggestions of how we can assist you in your application due to disability or personal reasons, please email recruitment@perchgroup.co.uk.

PLEASE NOTE – All new employees must undergo afull DBS and Credit Checkupon acceptance of a job offer with Perch Group.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer
Data Engineer

ACI-UK • Lancashire

Hybrid
GBP 40,000 - 45,000
Hybrid work model
Office in Blackpool
Performance bonus up to 20%
Senior Database Reliability Engineer
Senior Database Reliability Engineer

Perch Group • Manchester

Hybrid
GBP 54,000 - 66,000
Bonus up to 20%
Pension contributions
EAP programme
+3
Senior Solutions Engineer
Senior Solutions Engineer

Perch Group • Blackpool

Hybrid
GBP 60,000 - 75,000
Bonus up to 20%
Pension contributions
EAP programme
+4
Senior Database Reliablity Engineer
Senior Database Reliablity Engineer

Perch Group • Lancashire

Hybrid
GBP 60,000 - 72,000
Bonus up to 20%
Hybrid work in Blackpool or Manchester
37.5 hour work week
+2
IT Director
IT Director

Perch Group • Lancashire

Hybrid
GBP 90,000 - 110,000
Bonus up to 20%
Life insurance
Car scheme
+2
Strategy Analyst
Strategy Analyst

Perch Group • Lancashire

Hybrid
GBP 38,000 - 45,000
Bonus up to 20%
Hybrid work model
Office in Blackpool or Manchester
+1
Data and Solutions Engineer
Data and Solutions Engineer

Perch Group • Manchester

Hybrid
GBP 40,000 - 45,000
Up to 20% annual salary bonus
Flexible working hours
Formal qualifications opportunity
+1
Portfolio Performance Analyst
Portfolio Performance Analyst

ACI-UK • Manchester

Hybrid
GBP 35,000 - 45,000
Hybrid working
Bonus up to 20%
Learning opportunities
Client Development Manager
Client Development Manager

Perch Group • Lancashire

Hybrid
GBP 54,000 - 66,000
Hybrid work
Office in Blackpool & Manchester
Learning & qualifications
+1
Graduate Portfolio Performance Analyst
Graduate Portfolio Performance Analyst

ACI-UK • Manchester

Hybrid
GBP 30,000 - 35,000
Hybrid work model
Career progression
Formal qualifications support
+1