Senior Data Engineer and Data Manager

ZipRecruiter; Cardiff; Hybrid; GBP 45,000 - 55,000; Full time

Job summary

Join a forward-thinking civil service organization as a Senior Data Engineer and Data Manager, where your expertise in data integration and governance will drive impactful projects. This innovative role allows you to work autonomously while collaborating with a supportive team, utilizing cutting-edge technologies like Azure Data Factory and T-SQL. Enjoy a hybrid working environment, generous leave, and a strong commitment to employee wellbeing. If you're passionate about data and making a difference, this opportunity is perfect for you.

Benefits

31 days annual leave

Flexible working arrangements

Generous employer contribution

Time off for wellbeing activities

Green car scheme

Access to subsidized sports groups

Qualifications

• 2+ years of experience managing large datasets with T-SQL.
• Knowledge of Microsoft cloud tools for data automation.

Responsibilities

• Lead data integrations and ensure alignment with governance standards.
• Build and maintain data pipelines for efficient data operations.

Skills

Data Integration

Data Governance

T-SQL

Azure Data Factory

Python

Tools

Azure Synapse Link

Dynamics 365

QGIS

Job description

Job Description

Role: Senior Data Engineer and Data Manager

Salary: £45,974 to £54,430

Location: Cardiff (hybrid)

The Opportunity

Yolk Recruitment is excited to work with an innovation-driven civil service organization involved in impactful projects, emphasizing forward-thinking and excellent digital practices.

Role Overview:

This role offers the opportunity to work in an organization that extensively uses data to inform its work. As a key member of the data team, you will support evidence-based decision-making and collaborate with colleagues who value this contribution. You will receive support from friendly team members and other departments but also enjoy autonomy in your role.

Key Responsibilities:

Data Integration & Governance

• Lead and manage data integrations between internal systems and third-party services.
• Serve as the main contact for integration queries internally and externally.
• Ensure data flows are consistent, cost-effective, and aligned with system architecture.
• Collaborate with technical and non-technical teams to ensure integration projects adhere to data governance, quality, and versioning standards.
• Document all integrations and maintain current records.

Data Pipeline Development & Management

• Build and maintain data pipelines for data ingestion from various sources.
• Automate data processes to support scalable and efficient operations.
• Manage and optimize storage structures to facilitate data analysis.
• Oversee access controls and ensure data security within the environment.

Tools & Environment Maintenance

• Maintain custom software used within the analytics environment.
• Uphold best practices for data security, storage, and access, especially in a cloud setup.

Technologies:

• Minimum two years' experience managing and manipulating large datasets, including use of T-SQL.
• Knowledge of Microsoft cloud tools automating data extraction, load, and transformation, such as Azure Data Factory and Azure Synapse Link.
• Familiarity with Dynamics 365, Dynamics F&O, Microsoft Dataverse, and Power Platform.
• Experience with spatial data tools like QGIS or similar, and programming languages such as Python.

Benefits:

• 31 days annual leave plus Bank Holidays and 2 Privilege days.
• Flexible and hybrid working arrangements.
• Generous employer contribution of 28.97%.
• Time off for wellbeing activities.
• Green car scheme, Cycle2Work, and season travel tickets.
• Access to subsidized sports groups.

Think this one's for you?

If you believe this Senior Data Engineer and Data Manager role suits you, please apply online.

Yolk Public Sector & Not-for-Profit team collaborates with organizations across the UK to fulfill recruitment needs and support diversity and inclusion objectives. We recruit for temporary, contract, and permanent positions, assisting applicants through the public sector recruitment process to secure their ideal jobs.

Yolk Recruitment is an equal opportunities employer, encouraging applications from all qualified candidates regardless of age, gender, educational background, parental status, or other protected characteristics. We celebrate diversity and support our team in bringing their whole selves to work.