Senior Data Engineer – Cloud Data Platform & Pipelines

Allscreens Nationwide Ltd; York and North Yorkshire; On-site; CAD 80,000 - 95,000; Full time

Benefits offered by this job

Disability Confident employer scheme

Job summary

Government Recruitment Service is seeking a Senior Data Engineer to help Defra scale its enterprise data capabilities. You will design and implement cloud-based data architectures, build robust ETL pipelines, and collaborate with delivery teams to unlock data value across the organisation.

You will work with Azure Synapse, Databricks, Python and SQL to deliver trusted datasets for analysts and data scientists, while promoting data quality and governance across the portfolio.

Qualifications

• Experience designing and implementing cloud-based data architectures.
• Proven experience with ETL pipelines and data governance.
• Ability to mentor and lead junior data engineers.

Responsibilities

• Design, build, and maintain cloud-based data platforms and architectures that integrate large, complex datasets, ensuring scalability, security, and performance.
• Develop and optimise ETL pipelines to ingest, transform, and deliver high-quality data for analytics and reporting.
• Implement robust data models and storage solutions that support efficient querying and enterprise-wide accessibility.
• Collaborate with stakeholders across Defra group to understand data requirements and deliver solutions that meet business needs.
• Ensure data quality and governance by applying validation frameworks, metadata management, and lineage tracking.
• Stay current with emerging data engineering tools and best practices, contributing to innovation and continuous improvement.
• Lead technical workstreams and mentor colleagues, fostering collaboration and engineering excellence.

Skills

Python

SQL

ETL

Data modeling

Data pipelines

Tools

Azure Synapse

Databricks

Job description

Government Recruitment Service is seeking a Senior Data Engineer to help Defra scale its enterprise data capabilities. You will design and implement cloud-based data architectures, build robust ETL pipelines, and collaborate with delivery teams to unlock data value across the organisation.

You will work with Azure Synapse, Databricks, Python and SQL to deliver trusted datasets for analysts and data scientists, while promoting data quality and governance across the portfolio.