Senior Data Engineer: ETL Architect & Platform Lead

Government Recruitment Service; York and North Yorkshire; On-site; GBP 50,000 - 70,000; Full time

Job summary

A governmental agency is seeking a Data Engineer to enhance their Data Analytics Service Team. The role involves reviewing and streamlining ETL processes, ensuring data quality in pipelines, and leading initiatives to optimize Azure resources. The ideal candidate will collaborate with civil service partners and adapt data handling practices in line with evolving best practices. Strong knowledge of Azure and experience in data processing are essential for this position.

Responsibilities

• Review, design, document, and streamline ETL processes for datasets.
• Ensure new datasets are added with correct processes.
• Propose changes based on best practices in data management.

Skills

ETL processes

Data processing in Azure

Leadership

Collaboration with data providers

Tools

Azure

Databricks

Job description

A governmental agency is seeking a Data Engineer to enhance their Data Analytics Service Team. The role involves reviewing and streamlining ETL processes, ensuring data quality in pipelines, and leading initiatives to optimize Azure resources. The ideal candidate will collaborate with civil service partners and adapt data handling practices in line with evolving best practices. Strong knowledge of Azure and experience in data processing are essential for this position.