Senior Data Engineer: Cloud Data Architect & Pipelines Lead

Allscreens Nationwide Ltd; Newcastle upon Tyne; On-site; GBP 43,000 - 50,000; Full time

Benefits offered by this job

Disability Confident employer scheme

Job summary

Government Recruitment Service in the United Kingdom is seeking a Senior Data Engineer to drive enterprise data engineering initiatives within the Defra data ecosystem. You will lead cloud-based data platforms, design robust ETL pipelines, and collaborate with cross-government teams to unlock data value for analytics and decision-making.

The role emphasizes leadership, mentoring, and governance across data assets, with a permanent, full-time arrangement based in Newcastle-upon-Tyne.

Qualifications

• Experience designing cloud-based data platforms and architectures.
• Experience building and optimising ETL pipelines for analytics.
• Knowledge of data governance, metadata management, and data lineage.
• Ability to collaborate with Defra stakeholders and mentor peers.

Responsibilities

• Design, build, and maintain cloud-based data platforms and architectures that integrate large, complex datasets, ensuring scalability, security, and performance.
• Develop and optimise ETL pipelines to ingest, transform, and deliver high-quality data for analytics, reporting, and operational use.
• Implement robust data models and storage solutions that support efficient querying, data integrity, and enterprise-wide accessibility.
• Collaborate with stakeholders across Defra group to understand data requirements, integrate multiple sources, and deliver solutions that meet business needs.
• Ensure data quality and governance by applying validation frameworks, metadata management, and lineage tracking to maintain trusted datasets.
• Stay current with emerging data engineering tools and best practices, contributing to innovation and continuous improvement within the team.
• Lead technical workstreams and mentor colleagues, fostering a culture of collaboration, knowledge sharing, and engineering excellence.

Skills

Leadership

Mentoring

Data governance

Data modelling

Communication

Tools

Azure Synapse

Databricks

Python

SQL

ETL pipelines

Job description

Government Recruitment Service in the United Kingdom is seeking a Senior Data Engineer to drive enterprise data engineering initiatives within the Defra data ecosystem. You will lead cloud-based data platforms, design robust ETL pipelines, and collaborate with cross-government teams to unlock data value for analytics and decision-making.

The role emphasizes leadership, mentoring, and governance across data assets, with a permanent, full-time arrangement based in Newcastle-upon-Tyne.