Senior Data Engineer: Data Pipelines & Cloud Architecture

UK Home Office; Liverpool; On-site; GBP 50,000 - 70,000; Full time

Job summary

A government agency in the United Kingdom is seeking a Senior Data Engineer to lead the design and implementation of complex data flows. This full-time role requires collaboration with analysts and stakeholders, along with the mentoring of junior team members. The ideal candidate will have strong data analysis skills, experience with ETL tools, and knowledge of cloud platforms, particularly Azure and M365.

Qualifications

• 3+ years of experience in data analysis and solution design.
• Proven experience with ETL tools and data engineering practices.
• Strong programming skills in Python and PowerShell.

Responsibilities

• Analyze problems and develop innovative solutions.
• Design and implement data streaming services and ETL processes.
• Deliver and troubleshoot data loads for customers and data scientists.
• Build and test complex data products and solutions.

Skills

Data analysis

ETL tools

Python

PowerShell

Cloud Data technologies

API design principles

Tools

Azure Data Factory

MSSQL

OneLake

Microsoft Graph APIs

Job description

A government agency in the United Kingdom is seeking a Senior Data Engineer to lead the design and implementation of complex data flows. This full-time role requires collaboration with analysts and stakeholders, along with the mentoring of junior team members. The ideal candidate will have strong data analysis skills, experience with ETL tools, and knowledge of cloud platforms, particularly Azure and M365.