Data Engineer

People's Partnership; Crawley; Hybrid; GBP 45,000 - 60,000; Full time

Job summary

A not-for-profit organisation in Crawley is seeking a Data Lineage Engineer to advance their data lineage efforts. The role involves technical discovery, mapping, and documentation of data flows. Candidates should possess strong SQL skills and experience with ETL processes, as well as familiarity with Azure tools. Join a diverse team dedicated to fairness and simplicity in service delivery while enjoying a flexible working arrangement.

Qualifications

• Proven background in data pipelines, ETL/ELT processes, and data integration technologies.
• Experience mapping complex data flows across heterogeneous systems.
• Ability to interpret and document technical metadata with precision.

Responsibilities

• Play a critical role in delivering data lineage work.
• Inventory all systems and data sources.
• Document technical metadata and system interfaces.
• Map end-to-end data flows including ETL pipelines.
• Develop visual models of data movement.
• Produce high quality documentation for governance.

Skills

Strong SQL skills

Data pipelines experience

ETL/ELT processes knowledge

Data integration technologies

Technical metadata interpretation

Data catalogue tools understanding

API integrations familiarity

Microsoft Azure (Data Factory, Databricks, Data Lake)

Tools

Purview

Job description

Overview

At the heart of our not-for-profit organisation is a commitment and a motivation to make the future-saving experience a simple one for our members. We champion fairness and simplicity, not profit-chasing. Imagine a financial adventure where everyone's a winner, fuelled by our exceptional service and brought to life by the fantastic individuals who work for us. We're a diverse employer with a flexible, hybrid working approach, ensuring everyone gets the opportunity to come to work and be the best version of themselves.

Responsibilities

What you'll be doing:

The Data Lineage Engineer will play a critical role in delivering the organisation’s data lineage work. This role is responsible for the technical discovery, mapping, and documentation of data flows across systems, integrations, and databases. The engineer will reverse engineer existing technical assets, surface metadata, and create clear, maintainable technical documentation that supports governance, audit readiness, and operational improvements.

• Inventory all systems and data sources, including structured, semi‑structured, and unstructured data environments.
• Document technical metadata, ownership, and system interfaces in collaboration with system owners and SMEs.
• Map end-to-end data flows, including ETL pipelines, APIs, integrations, and batch processes.
• Develop visual models of data movement from source to consumption destinations (BI tools, apps, warehouses).
• Contribute technical definitions and lineage insights to the Data Dictionary.
• Produce high quality, standardised documentation suitable for inclusion in governance platforms.

Qualifications

What we’re looking for:

• Strong SQL skills, with experience reverse engineering stored procedures and database objects.
• Proven background in data pipelines, ETL/ELT processes, and data integration technologies.
• Experience mapping complex data flows across heterogeneous systems.
• Ability to interpret and document technical metadata with precision.
• Experience with data catalogue or metadata management tools, such as Purview.
• Familiarity with API integrations, workflow automation, or legacy systems.
• Experience with Microsoft Azure (Data Factory, Databricks, Data Lake, Lakehouse)

Disability Statement

People's Partnership is an equal opportunities employer. We believe everyone has the right to be treated fairly, with dignity and respect. We are committed to treating all our people (and all who apply for a role at People's Partnership) equally and enabling them to perform at their best and demonstrate what they have to offer. We are a disability committed employer, please let us know if you need any reasonable adjustments made to our recruitment process (application, selection assessments where relevant, and interview) to enable you to show us the best “you”.