Senior Data Engineer (£44,241 - £58,997)

Government Recruitment Service; Oldham; On-site; GBP 45,000 - 60,000; Full time

Job summary

A public sector recruitment agency in the UK is seeking a Data Engineer to build and optimize scalable data pipelines for analytics. The role involves designing ETL and streaming solutions, ensuring data quality and compliance with standards, and mentoring junior engineers. Candidates should have strong experience in data pipeline management, cloud optimization, and automation practices. This role offers an opportunity to significantly impact data-driven decision-making across government services.

Qualifications

• Proven experience in designing and operating ETL and streaming pipelines.
• Strong knowledge of data quality, standards, and compliance.
• Experience in automating deployment, testing, and monitoring.

Responsibilities

• Design, build and operate data pipelines for analytics.
• Implement data modelling and quality standards.
• Integrate diverse data sources for real-time ingestion.
• Automate deployment and ensure data security.
• Mentor junior engineers and promote best practices.

Skills

ETL and streaming pipeline design

Data quality assurance

Cloud/on-premise performance optimization

API integration

CI/CD and observability tools

Collaboration with analytics teams

Job description

Build, maintain and optimise scalable, secure data pipelines and platforms that enable analytics, reporting and operational data products across government. Work with data architects, analysts and stakeholders to translate requirements into robust ETL/streaming solutions, ensure data quality and compliance with standards, and drive automation and reuse to support evidence‑based policy and service delivery.

Your responsibilities will include, but aren’t limited to:

• Design, build and operate ETL and streaming pipelines for large, varied datasets.
• Implement and enforce data modelling, lineage and quality standards.
• Optimise storage, processing and query performance on cloud/on‑prem platforms.
• Integrate data sources via APIs, batch and real‑time ingestion methods.
• Automate deployment, testing and monitoring using CI/CD and observability tools.
• Collaborate with analysts, data scientists and product teams to deliver reusable data products.
• Ensure data security, access controls and compliance with government data standards.
• Mentor junior engineers and contribute to engineering best practices and documentation.

For further information on the role, please read the attached role profile. Please note that the role profile is for information purposes only - whilst all elements are relevant to the role, they may not all be assessed during the recruitment process. This job advert will detail exactly what will be assessed during the recruitment process.