Senior Data Engineer: Cloud, ETL & NLP Lead

UK Home Office; Sheffield; Hybrid; GBP 56,000 - 69,000; Full time

Benefits offered by this job

Civil Service Pension

25 days annual leave

8 public holidays

Hybrid work 60% in office

Job summary

The UK Home Office is seeking a Lead Data Engineer for the National Data Quality Improvement Service (NDQIS) to design, deliver, and support end-to-end data solutions. You will translate business requirements into robust pipelines, ensuring governance, security, and reliability across data integrations and automated workflows.

You will drive the data engineering vision, promote best practices, and lead a team to build scalable data products while collaborating with analysts and stakeholders to

Qualifications

• Design, deliver and support end-to-end data solutions for data-driven decision making.
• Translate business requirements into robust, scalable data pipelines with governance and security in mind.
• Lead data integrations, ETL processes and automated workflows from multiple sources.

Responsibilities

• Manage data sources to improve quality and preparation for analysis.
• Develop and support complex data workflows and large-scale data products across the delivery lifecycle.
• Lead stakeholder engagement and manage expectations while fostering a data-focused service culture.
• Ensure data privacy and information security standards are met in solutions.

Skills

Python

NLP

API integration

SQL

Data analysis

Tools

AWS

Docker

Git

Github

CI/CD pipelines

Python-based automation

Job description

The UK Home Office is seeking a Lead Data Engineer for the National Data Quality Improvement Service (NDQIS) to design, deliver, and support end-to-end data solutions. You will translate business requirements into robust pipelines, ensuring governance, security, and reliability across data integrations and automated workflows.

You will drive the data engineering vision, promote best practices, and lead a team to build scalable data products while collaborating with analysts and stakeholders to