Senior Data Engineer: Scalable Pipelines & Data Quality

Government Recruitment Service; Oldham; On-site; GBP 45,000 - 60,000; Full time

Job summary

A public sector recruitment agency in the UK is seeking a Data Engineer to build and optimize scalable data pipelines for analytics. The role involves designing ETL and streaming solutions, ensuring data quality and compliance with standards, and mentoring junior engineers. Candidates should have strong experience in data pipeline management, cloud optimization, and automation practices. This role offers an opportunity to significantly impact data-driven decision-making across government services.

Qualifications

• Proven experience in designing and operating ETL and streaming pipelines.
• Strong knowledge of data quality, standards, and compliance.
• Experience in automating deployment, testing, and monitoring.

Responsibilities

• Design, build and operate data pipelines for analytics.
• Implement data modelling and quality standards.
• Integrate diverse data sources for real-time ingestion.
• Automate deployment and ensure data security.
• Mentor junior engineers and promote best practices.

Skills

ETL and streaming pipeline design

Data quality assurance

Cloud/on-premise performance optimization

API integration

CI/CD and observability tools

Collaboration with analytics teams

Job description

A public sector recruitment agency in the UK is seeking a Data Engineer to build and optimize scalable data pipelines for analytics. The role involves designing ETL and streaming solutions, ensuring data quality and compliance with standards, and mentoring junior engineers. Candidates should have strong experience in data pipeline management, cloud optimization, and automation practices. This role offers an opportunity to significantly impact data-driven decision-making across government services.