Data Quality Developer

Southern Housing; Farringdon; Hybrid; GBP 65,000 - 90,000; Full time

Job summary

Southern Housing is seeking a Data Quality Developer to design, build and continuously improve data quality solutions across Microsoft Fabric and Experian Aperture Data Studio. You will profile, validate, cleanse and improve data, ensuring secure, traceable outputs back to Fabric while collaborating with Data Quality Engineers and Analysts.

You will implement ETL/ELT processes, data models and governance practices, automating monitoring and exception handling as part of a cross-functional team

Qualifications

• Strong practical experience of Microsoft Fabric, including data engineering workloads and lakehouse structures.
• Proficient in SQL and at least one programming language (Python, Postgres, PySpark or Java).
• Experience designing, developing and supporting ETL/ELT pipelines in a cloud data platform.
• Solid understanding of data quality principles: profiling, validation, standardisation, cleansing and monitoring.

Responsibilities

• Design, build and continuously improve data quality pipelines, transformations and tooling across Fabric and Aperture Data Studio.
• Develop data flows that profile, validate, cleanse and standardise data, then deliver outputs to Fabric.
• Implement ETL/ELT processes, data models, and integration patterns with appropriate controls and logging.
• Investigate, resolve data quality issues and monitor performance, reliability and completeness of data quality processes.

Skills

Microsoft Fabric

SQL

Python

PostgreSQL

PySpark

Java

ETL/ELT pipelines

Data quality

Experian Aperture Data Studio

Database design

Data modelling

Metadata

Data lineage

Version control

Testing & deployment

Azure Data Factory

Azure Analysis Services

Microsoft SQL Server

Power BI

Data lakes

Job description

About The Role

We’re looking for a motivated, analytical and solutions-focused Data Quality Developer who is passionate about using technology and high-quality data to drive better decisions and improve services. At Southern Housing, we believe reliable data and meaningful insight are essential to supporting our residents and shaping the future of our organisation, and this role will play a vital part in making that happen.

Reporting to the Head of Data Quality and Improvement, you’ll be the technical specialist responsible for designing, building, implementing and continuously improving our data quality solutions across Microsoft Fabric and Experian Aperture Data Studio.

You’ll focus on data quality development and engineering, creating reliable, controlled and traceable data flows between Microsoft Fabric and Aperture Data Studio. This will include developing the processes needed to profile, validate, cleanse and improve data, before returning approved outputs safely to Microsoft Fabric.

Working closely with the Data Quality and Improvement Manager, Data Engineers and the Data Engineering Guild, you’ll translate data quality requirements into scalable, secure and supportable technical solutions. You’ll also help ensure that the required data, metadata and technical information are available to support effective profiling, rule development, monitoring and continuous improvement.

You’ll design, build and maintain data quality pipelines, transformations and supporting processes, while configuring and developing data quality tooling within Aperture Data Studio. This may include connections, datasets, profiling, validation, standardisation, cleansing, matching, transformation and export processes.

You’ll also support the design and implementation of ETL and ELT processes, data models and integration patterns. Where possible, you’ll automate data quality monitoring and processing, supported by appropriate controls, logging, documentation and exception handling.

As part of the role, you’ll investigate and resolve technical data quality issues across Microsoft Fabric, Aperture Data Studio and connected data flows. You’ll monitor the performance, reliability and completeness of data quality processes and ensure that solutions comply with our data governance, information security, data protection, architecture and change-control requirements.

This role is based at our Farringdon office, with the option to work in a hybrid way where appropriate and as agreed with your manager.

About you

If you’re curious, detail-oriented and enjoy solving complex technical and data challenges, you’ll fit right in. You’ll be confident turning data quality requirements into dependable technical solutions and comfortable working collaboratively with both technical specialists and data quality practitioners.

You’ll bring:

• Strong practical experience of Microsoft Fabric, including data engineering workloads, Lakehouse or Warehouse structures, notebooks, pipelines and medallion architecture.
• Strong practical experience of SQL and at least one relevant programming language, such as Python, Postgres, PySpark or Java.
• Experience designing, developing and supporting ETL or ELT pipelines and data integration processes within a cloud data platform.
• A strong understanding of data quality principles and processes, including data profiling, validation, standardisation, cleansing, matching, monitoring and exception management.
• Experience with data quality tools, ideally Experian Aperture Data Studio or a comparable enterprise data quality platform.
• An understanding of database design, data modelling, metadata, data lineage, version control, testing and deployment practices.
• Experience working with relevant Microsoft data technologies, which may include Microsoft Azure data services, Azure Data Factory, Azure Analysis Services, Microsoft SQL Server, Power BI, data lakes and data management tools.

About the team

You’ll be part of our Data Quality and Improvement team within the wider Data and Digital directorate, working alongside Data Quality Analysts, Data Engineers, developers, architects and other technical specialists.

The team works collaboratively to improve the quality, reliability and usability of data across Southern Housing. This includes developing and maintaining data quality solutions, building controlled data flows, supporting data profiling and improvement activity, and ensuring that data can be used confidently to support operational and strategic decision-making.

About Us

At Southern Housing, our residents are at the heart of everything we do. As one of the largest housing providers in the UK with over 77,000 homes across London, the Southeast, the Isle of Wight, and the Midlands, we give over 167,000 people somewhere affordable to call their own! We also understand the difference that safe, secure, and affordable homes can make to people’s lives.

A career at Southern Housing will allow you to make a difference every day you come to work. Working in the housing sector with us will bring fresh challenges and give you the opportunity to grow and develop, too.