Data Engineer
Allscreens Nationwide Ltd
Get more replies from employers
Send a job-specific resume in minutes.
Job summary
United Welsh is hiring a Data Engineer to develop and maintain a modern data platform. You will work in the Data & Insights team to build scalable data solutions and support reporting, analytics and decision-making across Wales.
The role involves evaluating Microsoft Fabric through PoC activities, testing capabilities like Data Factory, Lakehouse and Dataflows, and ensuring governance, security and value in data projects.
Qualifications
- Experience in data engineering, ETL/ELT development and data integration.
- Experience with Microsoft Azure data technologies and/or modern cloud data platforms.
- Knowledge of data governance, security and data quality principles.
Responsibilities
- Design, build and maintain data solutions using Microsoft Fabric and Azure Data Lake.
- Develop and support data pipelines to ingest, transform and curate data.
- Support modern Lakehouse architecture including Bronze, Silver and Gold layers.
Skills
Tools
Job description
Please note, this vacancy closes at 12pm, midday, on Monday 7th September.
We reserve the right to close this vacancy early if we receive a high volume of suitable applications.
Interviews will take place as and when suitable candidates are identified.
Company: United Welsh
Salary: £46,710
Hours: Full-time
Location: Caerphilly, CF83 2AX
Job type: Permanent
Posting date: 6 Aug 2026
Closing date: 5 Sept 2026
The Data Engineer will play a key role in developing, maintaining and continually improving United Welsh's modern data platform.
Working as part of the Data & Insights team, the role will help build reliable, scalable and secure data solutions that support reporting, analytics, operational decision-making and future innovation.
As United Welsh modernises its data estate and explores the future direction of its data platform, the Data Engineer will support the evaluation, testing and implementation of modern data technologies, including Microsoft Fabric and other cloud-based solutions where appropriate.
A key part of this role will be involvement in proof-of-concept and pilot activity for Microsoft Fabric. The role will help assess whether Fabric is the right long-term platform for United Welsh by testing functionality, performance, scalability, governance, security and business value before wider decisions are made.
The role will work closely with BI Partners, the Data Governance Analyst, business stakeholders and third-party suppliers to ensure quality data is available when and where it is needed. This is an opportunity to contribute to a growing data capability and help improve outcomes for colleagues and customers across South Wales.
- Design, build and maintain data solutions using Microsoft Fabric, Azure Data Lake and related Microsoft technologies where appropriate.
- Develop and support data pipelines that ingest, transform and curate data from a range of internal and external systems.
- Support the ongoing development of a modern Lakehouse-style architecture, including Bronze, Silver and Gold data layers.
- Maintain and enhance trusted, reusable datasets that support reporting, analytics and operational insight.
- Monitor and optimise platform performance, reliability, efficiency and cost awareness.
- Support the design, delivery and evaluation of Microsoft Fabric proof-of-concept and pilot activity.
- Test Fabric capabilities including Data Factory, Lakehouse, Dataflows, pipelines, semantic models and integration with Power BI.
- Assess if the platform meets criteria such as functionality, scalability, security, governance, performance and business value.
- Record technical findings, risks, dependencies and lessons learned to inform future platform decisions.
- Work with the Data and Insights Manager and wider team to provide clear recommendations based on pilot outcomes.
- Develop transformation logic that cleanses, validates and enriches data for operational and analytical use.
- Create and maintain reusable data sets and semantic models that support reporting and insight requirements.
- Apply good-practice data modelling techniques, including dimensional modelling and star schema design where appropriate.
- Work with business users to understand data requirements and translate them into scalable technical solutions.
- Support system implementation and data migration projects through data mapping, transformation, validation and reconciliation activity.
- Work with business stakeholders and third-party suppliers to understand source and target system requirements.
- Identify and help resolve data quality issues that may impact migration activity or reporting outcomes.
- Help with repeatable migration processes, templates and validation approaches for future implementation activity.
- Support and maintain existing migration solutions developed using SQL Server Integration Services (SSIS), and be comfortable with working with and enhancing established migration processes where appropriate.
- Assist in the transition of migration processes from legacy approaches to modern cloud-based data engineering solutions where appropriate.
- Maintain high standards of data quality, accuracy, completeness and consistency.
- Build quality checks and validation processes into engineering solutions wherever possible.
- Work closely with the Data Governance Analyst to support data standards, classifications, lineage and quality monitoring.
- Create and maintain technical documentation, including data dictionaries, schemas, process flows and solution designs.
- Ensure data engineering activity supports organisational policies, compliance requirements and good governance practice.
- Implement and maintain appropriate security controls within data solutions.
- Support role-based access controls and secure handling of sensitive information.
- Contribute to the development of secure and well-governed data products.
- Ensure data engineering activity aligns with GDPR and organisational data protection requirements.
- Use Git-based source control to manage code, configurations and reusable components.
- Contribute to CI/CD processes using Azure DevOps and other platform tooling.
- Follow agreed development standards, testing processes and change control procedures.
- Identify opportunities to automate manual processes and improve platform efficiency.
- Support adoption of emerging technologies, including AI-assisted development tools where appropriate.
- Work collaboratively with BI Partners, the Data Governance Analyst, the Data & Insights Manager and business stakeholders.
- Participate in Agile delivery activity, including sprint planning, reviews and retrospectives.
- Support testing, validation and continuous improvement of data products and solutions.
- Communicate effectively with both technical and non-technical audiences.
- Take ownership of workload, priorities and delivery commitments.
- Experience in data engineering, ETL/ELT development and data integration.
- Experience working with Microsoft Azure data technologies and/or equivalent modern cloud data platforms.
- Experience with Microsoft Fabric, including Data Factory, Lakehouse, Dataflows and Semantic Models.
- Strong knowledge of SQL and data transformation techniques.
- Experience supporting data migration or system implementation projects.
- Experience working with SQL Server Integration Services (SSIS) and maintaining or developing ETL solutions.
- Experience working with cloud-based data platforms and modern data architectures.
- Understanding of data modelling principles and analytics-ready data design.
- Knowledge of data governance, security and data quality principles.
- Experience using source control tools such as Git.
- Exposure to CI/CD processes and Azure DevOps or similar tools.
- Experience evaluating, testing or implementing new technologies, platforms or tools within a business environment.
- Ability to work independently and manage competing priorities.
- Strong communication and stakeholder engagement skills.
- Ability to translate business requirements into technical solutions.
- A proactive and continuous improvement mindset.
- Experience with Microsoft Dataverse and integration of Dataverse data into reporting and analytics platforms
- Experience participating in proof-of-concept projects, pilots or technology evaluations.
- Experience supporting data migration or business system implementation projects.
- Knowledge of Python, Spark or PySpark.
- Experience developing automated data quality checks and monitoring.
- Experience working with large operational systems and datasets.
- Understanding of housing sector data and business processes.
- Experience using AI-assisted engineering or automation tools.
- Experience working in Agile delivery environments.
- Welsh language skills
You will be joining a growing Data & Insights team at an exciting stage of its data journey. United Welsh is modernising how data is collected, managed and used across the organisation, and this role will help build the trusted foundations needed for better reporting, insight and decision-making.
This role offers the chance to work across data engineering, migration, governance, automation, analytics and platform evaluation.
It is particularly suited to someone who wants to broaden their experience, contribute to meaningful work and help shape how data supports services for customers and communities across Wales.
Requirements within the essential criteria of the Personal Requirements will be used for shortlisting purposes. However, all of the criteria will be considered in the process of making an appointment.
Proud member of the Disability Confident employer scheme
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
