Senior Data Engineer (£44,241 - £58,997)

Government Recruitment Service; Birmingham; On-site; GBP 60,000 - 80,000; Full time

Job summary

A government agency in Birmingham is seeking a skilled data engineer to build and maintain secure data pipelines, ensuring compliance and data quality. The role involves collaboration across teams to design robust ETL solutions and automate deployment processes. Ideal candidates will have extensive experience in data engineering, particularly with ETL/streaming pipelines, and a strong grasp of data modeling standards. This position offers the opportunity to drive evidence-based policy and improve data accessibility across government operations.

Qualifications

• Experience in designing and developing ETL and streaming data solutions.
• Knowledge of data modelling, lineage and quality standards.
• Familiar with cloud and on-premise data storage and processing.

Responsibilities

• Build and maintain ETL and streaming data pipelines.
• Ensure compliance with government data standards.
• Collaborate with analysts and data scientists for effective data products.

Skills

ETL and streaming pipelines design

Data modelling and quality standards

Cloud platforms optimization

API integration

Automation using CI/CD tools

Collaboration with data teams

Data security and compliance

Mentoring junior engineers

Tools

CI/CD tools

Observability tools

Job description

Build, maintain and optimise scalable, secure data pipelines and platforms that enable analytics, reporting and operational data products across government. Work with data architects, analysts and stakeholders to translate requirements into robust ETL/streaming solutions, ensure data quality and compliance with standards, and drive automation and reuse to support evidence‑based policy and service delivery.

Your responsibilities will include, but aren’t limited to:

• Design, build and operate ETL and streaming pipelines for large, varied datasets.
• Implement and enforce data modelling, lineage and quality standards.
• Optimise storage, processing and query performance on cloud/on‑prem platforms.
• Integrate data sources via APIs, batch and real‑time ingestion methods.
• Automate deployment, testing and monitoring using CI/CD and observability tools.
• Collaborate with analysts, data scientists and product teams to deliver reusable data products.
• Ensure data security, access controls and compliance with government data standards.
• Mentor junior engineers and contribute to engineering best practices and documentation.

For further information on the role, please read the attached role profile. Please note that the role profile is for information purposes only - whilst all elements are relevant to the role, they may not all be assessed during the recruitment process. This job advert will detail exactly what will be assessed during the recruitment process.