Data Quality Developer

Southern Housing; Fleet; On-site; GBP 65,000 - 90,000; Full time

Benefits offered by this job

Hybrid work model

Office in Farringdon

Job summary

Southern Housing seeks a Data Quality Developer to design, build and continuously improve data quality solutions across Microsoft Fabric and Experian Aperture Data Studio. You will profile, validate, cleanse and transform data, ensuring outputs are safe to return to Fabric.

You’ll work with the Data Quality and Improvement team to deliver scalable, secure data flows, automated monitoring and governance-aligned processes in a hybrid working model from our Farringdon office.

Qualifications

• Strong practical experience with Microsoft Fabric data engineering workloads (Lakehouse/Warehouse, pipelines, medallion architecture).
• Proficiency in SQL and at least one language (Python, Postgres, PySpark, Java).
• Experience designing, developing and supporting ETL/ELT pipelines in a cloud data platform.
• Solid understanding of data quality principles: profiling, validation, cleansing, monitoring, exception management.
• Experience with data quality tooling (Experian Aperture Data Studio) or similar enterprise platforms.
• Understanding of database design, data modelling, metadata, data lineage, version control, testing and deployment practices.
• Experience with Microsoft data technologies (Azure Data Factory/SQL Server/Power BI, data lakes).

Responsibilities

• Design, build and maintain data quality pipelines, transformations and supporting processes.
• Configure and develop data quality tooling within Aperture Data Studio, including connections, datasets, profiling and validation.
• Automate data quality monitoring and processing with appropriate controls and logging.
• Investigate and resolve technical data quality issues across Fabric, Aperture Data Studio and connected data flows.
• Ensure data governance, information security and change-control requirements are met.

Skills

Microsoft Fabric

SQL

Python

Postgres

PySpark

Java

ETL/ELT pipelines

Data quality principles

Version control

Data modelling

Tools

Experian Aperture Data Studio

Job description

We’re looking for a motivated, analytical and solutions-focused Data Quality Developer who is passionate about using technology and high-quality data to drive better decisions and improve services. At Southern Housing, we believe reliable data and meaningful insight are essential to supporting our residents and shaping the future of our organisation, and this role will play a vital part in making that happen.

Reporting to the Head of Data Quality and Improvement, you’ll be the technical specialist responsible for designing, building, implementing and continuously improving our data quality solutions across Microsoft Fabric and Experian Aperture Data Studio.

You’ll focus on data quality development and engineering, creating reliable, controlled and traceable data flows between Microsoft Fabric and Aperture Data Studio. This will include developing the processes needed to profile, validate, cleanse and improve data, before returning approved outputs safely to Microsoft Fabric.

Working closely with the Data Quality and Improvement Manager, Data Engineers and the Data Engineering Guild, you’ll translate data quality requirements into scalable, secure and supportable technical solutions. You’ll also help ensure that the required data, metadata and technical information are available to support effective profiling, rule development, monitoring and continuous improvement.

You’ll design, build and maintain data quality pipelines, transformations and supporting processes, while configuring and developing data quality tooling within Aperture Data Studio. This may include connections, datasets, profiling, validation, standardisation, cleansing, matching, transformation and export processes.

You’ll also support the design and implementation of ETL and ELT processes, data models and integration patterns. Where possible, you’ll automate data quality monitoring and processing, supported by appropriate controls, logging, documentation and exception handling.

As part of the role, you’ll investigate and resolve technical data quality issues across Microsoft Fabric, Aperture Data Studio and connected data flows. You’ll monitor the performance, reliability and completeness of data quality processes and ensure that solutions comply with our data governance, information security, data protection, architecture and change-control requirements.

This role is based at our Farringdon office, with the option to work in a hybrid way where appropriate and as agreed with your manager.

About You

If you’re curious, detail-oriented and enjoy solving complex technical and data challenges, you’ll fit right in. You’ll be confident turning data quality requirements into dependable technical solutions and comfortable working collaboratively with both technical specialists and data quality practitioners.

You’ll bring:

• Strong practical experience of Microsoft Fabric, including data engineering workloads, Lakehouse or Warehouse structures, notebooks, pipelines and medallion architecture
• Strong practical experience of SQL and at least one relevant programming language, such as Python, Postgres, PySpark or Java
• Experience designing, developing and supporting ETL or ELT pipelines and data integration processes within a cloud data platform
• A strong understanding of data quality principles and processes, including data profiling, validation, standardisation, cleansing, matching, monitoring and exception management
• Experience with data quality tools, ideally Experian Aperture Data Studio or a comparable enterprise data quality platform
• An understanding of database design, data modelling, metadata, data lineage, version control, testing and deployment practices
• Experience working with relevant Microsoft data technologies, which may include Microsoft Azure data services, Azure Data Factory, Azure Analysis Services, Microsoft SQL Server, Power BI, data lakes and data management tools

About The Team

You’ll be part of our Data Quality and Improvement team within the wider Data and Digital directorate, working alongside Data Quality Analysts, Data Engineers, developers, architects and other technical specialists.

The team works collaboratively to improve the quality, reliability and usability of data across Southern Housing. This includes developing and maintaining data quality solutions, building controlled data flows, supporting data profiling and improvement activity, and ensuring that data can be used confidently to support operational and strategic decision-making.