Cloud Data Engineer: Pipelines & Azure Data Platform

Dwr Cymru Cyf; Cardiff; On-site; GBP 45,000 - 65,000; Full time

Job summary

Dwr Cymru Cyf is seeking a Data Engineer to evolve our cloud-based enterprise data platform. You will design robust data pipelines, maintain SQL servers feeding analytics products, and support data-driven decision making for public services.

You will work across on‑premises and cloud environments, ensuring data quality, security, and scalable data delivery. Strong Python/SQL skills and experience with Microsoft data tools are essential.

Qualifications

• Substantial experience designing and managing data pipelines.
• Ability to add customer value while improving data engineering effectiveness.
• Proactive problem solving and clear communication to data teams and stakeholders.
• Good understanding of database administration principles.
• Knowledge of data transformation approaches.
• Strong Python and SQL programming capabilities.
• Knowledge of data security practices and permission models (AD/RBAC) and encryption/masking.
• Familiarity with agile project management in data/analytics contexts.
• Understanding ingestion patterns ETL/ELT in on-prem/cloud environments.
• Knowledge of data modelling approaches (Kimball).
• Experience with Microsoft data stack: Azure Data Lake, Synapse, Data Factory, Databricks.
• Experience across full software lifecycle.
• Knowledge of Microsoft BI stack (SSAS/SSIS/SSRS, Power BI).
• Understanding of DevOps, CI/CD and version control.

Responsibilities

• Designing efficient and robust data engineering projects within on-premises and cloud-based data stacks that add business value and comply with architectural and data security requirements.
• Building, maintaining and supporting data engineering pipelines, with resolution of incidents.
• End-to-end delivery of data engineering solutions, including data quality, testing, peer reviewing, documenting and demonstrating of completed solutions to the team.
• Working closely with teams within data and other technical colleagues across the business.
• Remaining aware of new data engineering approaches, and be able to suggest how the latest research, techniques and approaches could be implemented to achieve business benefit.
• Undertaking any other duties as required to meet the needs of the business.

Skills

Python

SQL

Data pipelines

Data security

Communication

DB administration

Data transformation

Tools

Azure Data Lake

Azure Synapse

Azure Data Factory

Databricks

Job description

Dwr Cymru Cyf is seeking a Data Engineer to evolve our cloud-based enterprise data platform. You will design robust data pipelines, maintain SQL servers feeding analytics products, and support data-driven decision making for public services.

You will work across on‑premises and cloud environments, ensuring data quality, security, and scalable data delivery. Strong Python/SQL skills and experience with Microsoft data tools are essential.