Senior Data Engineer and Data Manager

TN United Kingdom; Cardiff; Hybrid; GBP 45,000 - 75,000; Full time

Job summary

Join a forward-thinking civil service organisation as a Senior Data Engineer and Data Manager. In this hybrid role, you'll lead data integrations and support evidence-based decision-making, working with colleagues who value data contributions. You'll have the autonomy to manage data pipelines, ensure data quality, and maintain security in a cloud environment. Enjoy a generous benefits package, including 31 days of annual leave, flexible working arrangements, and a substantial employer contribution to your pension. This is an exciting opportunity to make a real impact in a dynamic team focused on digital excellence.

Benefits

31 days annual leave

Flexible working arrangements

Generous employer pension contribution

Wellbeing days off

Cycle2Work scheme

Subsidised sports groups

Qualifications

• Minimum two years' experience managing large datasets.
• Knowledge of Microsoft cloud tools and data integration.

Responsibilities

• Lead data integrations and manage data pipelines.
• Collaborate with teams to ensure data governance and quality.

Skills

T-SQL

Data Governance

Data Quality

Data Security

Python

Tools

Azure Data Factory

Azure Synapse

Dynamics 365

Dataverse

Power Platform

QGIS

Job description

Role: Senior Data Engineer and Data Manager

Location: Cardiff (hybrid)

Opportunity

Yolk Recruitment is partnering with an innovation-driven civil service organisation involved in exciting projects, emphasizing forward-thinking and digital excellence.

Role Overview

This position involves working within an organisation that extensively uses data to inform its operations. As part of the data team, you will support evidence-based decision-making, collaborating with colleagues who value data contributions. You will have support from your team but also autonomy in your role.

Key Responsibilities

• Lead data integrations between internal systems and third-party services.
• Act as the primary contact for integration queries internally and externally.
• Ensure data flows are consistent, cost-effective, and align with system architecture.
• Collaborate with technical and non-technical teams to ensure data governance, quality, and versioning.
• Document integrations and maintain records.
• Build and maintain data pipelines for ingestion from various sources.
• Automate data processes for scalable operations.
• Manage storage structures for easy data access.
• Oversee access controls and data security in a cloud environment.
• Maintain custom analytics software.
• Follow best practices for data security, storage, and access, especially in cloud setups.

Technologies

• Minimum two years' experience with management and manipulation of large datasets, including T-SQL.
• Knowledge of Microsoft cloud tools like Azure Data Factory and Azure Synapse.
• Understanding of Dynamics 365, Dynamics F&O, Dataverse, and Power Platform.
• Experience with spatial data tools like QGIS and programming languages like Python.

Benefits

• 31 days annual leave + bank holidays and 2 privilege days.
• Flexible, hybrid working arrangements.
• Generous employer contribution of 28.97%.
• Wellbeing days off, Cycle2Work, travel tickets, and subsidised sports groups.

Next Steps

If this Senior Data Engineer and Data Manager role interests you, please apply online.

Yolk Public Sector & Not-for-Profit team supports UK organisations with recruitment across various sectors, promoting diversity and equal opportunities.