Senior Data Engineer — Azure ETL Lead

Government Recruitment Service; Coventry; Remote; GBP 58,000 - 76,000; Full time

Job summary

Government Recruitment Service is seeking a Senior Data Engineer (G7) to lead Azure data engineering initiatives and design scalable ETL/ELT pipelines using PySpark and Python. You will guide stakeholder collaboration, ensure data availability, and oversee data governance across multiple systems.

Location options include London, Coventry, Darlington, Sheffield and Leeds, with a UK-wide posting and security clearance as a requirement for the role.

Qualifications

• Security Check clearance is required.
• UK residence: 3 of last 5 years, 2 of which immediately precede application.
• Senior Data Engineer with Azure data engineering and ETL/ELT design experience.

Responsibilities

• Lead the team in designing, developing and maintaining scalable ETL/ELT pipelines using PySpark and Python.
• Gather data requirements from stakeholders and shape datasets for analysts.
• Manage data supply to multiple systems and secure data availability with efficient scripts.
• Oversee large-scale data transformations and migrations, setting direction for change.
• Develop cloud data engineering pipelines and implement logging and monitoring.

Skills

Leadership

Stakeholder management

Agile practices

Tools

PySpark

Python

Google Cloud DataCatalog

AWS Glue DataCatalog

Azure DataCatalog

Informatica Enterprise DataCatalog

Alation

Apache Atlas

Job description

Government Recruitment Service is seeking a Senior Data Engineer (G7) to lead Azure data engineering initiatives and design scalable ETL/ELT pipelines using PySpark and Python. You will guide stakeholder collaboration, ensure data availability, and oversee data governance across multiple systems.

Location options include London, Coventry, Darlington, Sheffield and Leeds, with a UK-wide posting and security clearance as a requirement for the role.