Senior Data Engineer

Government Digital Service; Manchester; On-site; GBP 70,000 - 100,000; Full time

Job summary

The Government Digital Service (GDS) in Manchester is seeking a Senior Data Engineer to shape and scale data infrastructure across GOV.UK. You will connect operational systems with analytics, build robust data models and champion data best practices.

You will lead data engineering work, mentor peers, and collaborate with cross-functional teams to improve user experiences of government services through data. Proficiency in Python, SQL and Google Cloud is required.

Qualifications

• Experience translating user requirements and raw data into scalable, robust engineering solutions.
• Experience providing technical leadership for data engineering teams, setting priorities and direction.
• Production experience with Python and SQL, using Git-based workflows and CI/CD practices.
• Proven experience with Google Cloud technologies such as BigQuery, Dataform and Composer.

Responsibilities

• Lead on the design and implementation of complex data flows connecting operational systems, data for analytics and BI systems.
• Enable teams to use data to improve user experience by building data models fit for consumption.
• Define and evolve the technical standards and target state for GOV.UK’s data infrastructure, aligning with developers.

Skills

Data engineering principles

Python

SQL

Technical leadership

Mentoring

Git

CI/CD

Google Cloud

Tools

BigQuery

Dataform

Cloud Composer

Git

Job description

The Government Digital Service (GDS) is the digital centre of government. We are responsible for setting, leading and delivering the vision for a modern digital government.

Our priorities are to drive a modern digital government, by:

• joining up public sector services
• harnessing the power of AI for the public good
• strengthening and extending our digital and data public infrastructure
• elevating leadership and investing in talent
• funding for outcomes and procuring for growth and innovation
• committing to transparency and driving accountability

We are home to the Incubator for Artificial Intelligence (I.AI), the world-leading GOV.UK and at the forefront of coordinating the UK’s geospatial strategy and activity. We lead the Government Digital and Data function and champion the work of digital teams across government.

We’re part of the Department for Science, Innovation and Technology (DSIT) and employ more than 1,000 people all over the UK, with hubs in Manchester, London and Bristol.

The Government Digital Service is where talent translates into impact. From your first day, you’ll be working with some of the world’s most highly-skilled digital professionals, all contributing their knowledge to make change on a national scale.

Join us for rewarding work that makes a difference across the UK. You'll solve some of the nation’s highest-priority digital challenges, helping millions of people access services they need

Former DSIT recruitment campaigns are continuing as usual, but candidates should be aware that following the Government’s announcement on the changes to some civil service departments, roles will be subject to the machinery of government moves and will ultimately be in one of the new departments. We will provide more information if you are selected for a role. This work remains of high importance to the civil service, and we thank you for your continued interest.

You’ll be a technical data expert in GOV.UK and the voice of authority with regards to data infrastructure. You’ll be a key point of contact for our use of Google Cloud and the adoption of new technologies to support and lead the use of data within GOV.UK and GDS driving innovation and best practice.

As a Senior Data Engineer you’ll be uniquely positioned, spanning the data professionals and the technical communities to build links and support cross pollination of work.

As a Senior Data Engineer you’ll:

• lead on the design and implementation of numerous complex data flows to connect operational systems, data for analytics and business intelligence (BI) systems
• enable and support teams to make better use of data to improve user experience of government services, through building and refining data models fit for consumption
• identify, define and evolve the technical standards, architectural principals and target state for GOV.UK’s data infrastructure. Working closely with developers to bring data infrastructure in line with the standards of technical infrastructure
• identify areas of innovation in data tools and techniques and test and implement improvements
• be an active member of the tech and data engineering communities in GOV.UK and a technical expert for the GOV.UK Insights and Analytics team. You will be the link that joins our data and technical communities, mentoring, coaching or supporting the development of other data engineers

Person specification

We’re interested in people who:

• can demonstrate experience of working with good data engineering principals, translating user requirements and raw data into effective, scalable, robust engineering solutions in line with build standards and data regulations, ensuring code is production ready
• have experience providing technical leadership for data engineering teams, setting priorities and direction while establishing best practice and knowledge gaps
• have significant practical experience developing production data solutions using Python and SQL, using Git-based workflows, code review and CI/CD practices to manage and deploy production code
• can demonstrate strong practical background of using Google Cloud, including technologies such as BigQuery, Dataform and Composer
• can work as part of a multidisciplinary team to plan and prioritise work, sometimes working independently and sometimes pairing with developers/data practitioners, and mentoring, coaching or supporting the development of other data engineers in the community