Senior Data Engineer and Data Manager

Yolk Recruitment Ltd; Cardiff; Hybrid; GBP 45,000 - 55,000; Full time

Job description

Role: Senior Data Engineer and Data Manager

Salary: £45,974 to £54,430

Location: Cardiff (hybrid)

The Opportunity

Yolk Recruitment are excited to be working with an innovation-driven civil service organisation as they journey through some incredible projects whilst prioritising forward thinking and excellent digital practices.

Role Overview:

This is chance to work in an organisation that uses data extensively to directly inform its work. As a key part of the data team, you will be supporting the organisation in that evidence based decision-making and working with colleagues who value that contribution. You'll be supported by friendly colleagues from the immediate team as well as other parts of the organisation, but also have the autonomy to make decisions relevant to your role.

Key Responsibilities:

Data Integration & Governance

• Lead and manage data integrations between internal systems and third-party services.
• Serve as the main contact for integration queries across the organization and with external partners.
• Ensure data flows are consistent, cost-effective, and aligned with system architecture.
• Work closely with technical and non-technical teams to ensure integration projects account for data governance, quality, and versioning.
• Document all integrations and maintain up-to-date records.

Data Pipeline Development & Management

• Build and maintain data pipelines for ingestion from internal and external sources.
• Automate data processes to support scalable and efficient operations.
• Manage and optimize storage structures, enabling simplified data access for analysis.
• Oversee access controls and data security across the data environment.

Tools & Environment Maintenance

• Maintain custom software used within the analytics environment.
• Uphold data management best practices related to security, storage, and access within a cloud-based setup.

Technologies

• At least two years' experience in management and manipulation of both large record level and aggregated datasets, including use of T-SQL.
• Knowledge of Microsoft cloud-based tools automating extract, load and transform of data, including Azure Data Factory and Azure Synapse Link.
• Knowledge of Dynamics 365 and Dynamics F&O including their links to the Microsoft Dataverse and the Power Platform.
• Knowledge of spatial data processing tools, such as QGIS or a variant, and other coding languages, for example Python.

Benefits:

• 31 days annual leave + Bank Holidays, and 2 Privilege days.
• Flexible and hybrid working.
• Generous employer contribution of 28.97%.
• Time off for wellbeing activities.
• Green car scheme.
• Cycle2Work and season travel tickets.
• Access to subsidised sports groups.

Think this one's for you?

If you think this Senior Data Engineer and Data Manager opportunity is for you then please apply online.