Data Quality Engineer - Fabric & Aperture Pipelines

Southern Housing; Fleet; Hybrid; GBP 65,000 - 90,000; Full time

Job summary

Southern Housing is seeking a Data Quality Developer to design, build and continuously improve data quality solutions across Microsoft Fabric and Aperture Data Studio.

You’ll create reliable data flows, profile and validate data, and automate monitoring while ensuring governance and security standards are met. The role is based in London with hybrid working options and close collaboration with the Data Quality and Improvement team.

Qualifications

• Strong practical experience of Microsoft Fabric data engineering workloads, lakehouse/warehouse structures, notebooks, pipelines.
• Experience with SQL and programming languages such as Python, Postgres, PySpark or Java.
• Experience designing, developing and supporting ETL/ELT pipelines and data integration in a cloud data platform.
• A solid understanding of data quality principles including profiling, validation, cleansing, monitoring and exception management.
• Experience with data quality tooling, ideally Aperture Data Studio or similar.
• Understanding of database design, data modelling, metadata and data lineage.

Responsibilities

• Design, build and maintain data quality pipelines, transformations and supporting processes.
• Develop and automate data quality profiling, validation and cleansing steps across Microsoft Fabric and Aperture Data Studio.
• Implement ETL/ELT routines and data integration patterns with security and governance in mind.
• Monitor performance, reliability and completeness of data quality processes and resolve issues.
• Collaborate with Data Quality Analysts and Data Engineers to translate requirements into scalable solutions.

Skills

Microsoft Fabric

SQL

Python

ETL/ELT pipelines

Data quality principles

Aperture Data Studio

Azure Data Factory

Data modelling

Tools

Experian Aperture Data Studio

Azure Data Factory

SQL Server

Job description

Southern Housing is seeking a Data Quality Developer to design, build and continuously improve data quality solutions across Microsoft Fabric and Aperture Data Studio.

You’ll create reliable data flows, profile and validate data, and automate monitoring while ensuring governance and security standards are met. The role is based in London with hybrid working options and close collaboration with the Data Quality and Improvement team.