Senior Data Engineer

Government Digital Service; West of England; On-site; GBP 70,000 - 110,000; Full time

Job summary

Government Digital Service (GDS) is looking for a Senior Data Engineer to join GOV.UK Insights and Analytics. You will design and implement complex data flows, connect operational systems with analytics, and advance data infrastructure standards across GOV.UK.

Bring deep experience in Python, SQL, and Google Cloud (BigQuery, Dataform, Composer), and mentor a multidisciplinary data team while driving cross-functional data initiatives for the public sector.

Qualifications

• Experience delivering production data solutions with scalable architectures.
• Strong Python and SQL programming for data manipulation and tooling.
• Hands-on experience with Google Cloud services (BigQuery, Dataflow, Composer).
• Experience building data models for analytics and BI workloads.

Responsibilities

• Lead the design and implementation of complex data flows connecting operational systems and analytics.
• Enable teams to improve user experience by building data models for consumption.
• Define and evolve standards and target architecture for GOV.UK data infrastructure.
• Identify and試 implement data tool innovations and improvements.
• Mentor and support other data engineers within the GOV.UK data community.

Skills

Data engineering

Python

SQL

Google Cloud

CI/CD

Git workflows

Tools

BigQuery

Dataform

Composer

Job description

The Government Digital Service (GDS) is the digital centre of government. We are responsible for setting, leading and delivering the vision for a modern digital government.

Our priorities are to drive a modern digital government, by:

• joining up public sector services
• harnessing the power of AI for the public good
• strengthening and extending our digital and data public infrastructure
• elevating leadership and investing in talent
• funding for outcomes and procuring for growth and innovation
• committing to transparency and driving accountability

We are home to the Incubator for Artificial Intelligence (I.AI), the world-leading GOV.UK and at the forefront of coordinating the UK’s geospatial strategy and activity. We lead the Government Digital and Data function and champion the work of digital teams across government.

We’re part of the Department for Science, Innovation and Technology (DSIT) and employ more than 1,000 people all over the UK, with hubs in Manchester, London and Bristol.

The Government Digital Service is where talent translates into impact. From your first day, you’ll be working with some of the world’s most highly-skilled digital professionals, all contributing their knowledge to make change on a national scale.

Join us for rewarding work that makes a difference across the UK. You'll solve some of the nation’s highest-priority digital challenges, helping millions of people access services they need

Former DSIT recruitment campaigns are continuing as usual, but candidates should be aware that following the Government’s announcement on the changes to some civil service departments, roles will be subject to the machinery of government moves and will ultimately be in one of the new departments. We will provide more information if you are selected for a role. This work remains of high importance to the civil service, and we thank you for your continued interest.

You’ll be a technical data expert in GOV.UK and the voice of authority with regards to data infrastructure. You’ll be a key point of contact for our use of Google Cloud and the adoption of new technologies to support and lead the use of data within GOV.UK and GDS driving innovation and best practice.

As a Senior Data Engineer you’ll be uniquely positioned, spanning the data professionals and the technical communities to build links and support cross pollination of work.

As a Senior Data Engineer you’ll:

• lead on the design and implementation of numerous complex data flows to connect operational systems, data for analytics and business intelligence (BI) systems
• enable and support teams to make better use of data to improve user experience of government services, through building and refining data models fit for consumption
• identify, define and evolve the technical standards, architectural principals and target state for GOV.UK’s data infrastructure. Working closely with developers to bring data infrastructure in line with the standards of technical infrastructure
• identify areas of innovation in data tools and techniques and test and implement improvements
• be an active member of the tech and data engineering communities in GOV.UK and a technical expert for the GOV.UK Insights and Analytics team. You will be the link that joins our data and technical communities, mentoring, coaching or supporting the development of other data engineers

Person specification

We’re interested in people who:

• can demonstrate experience of working with good data engineering principals, translating user requirements and raw data into effective, scalable, robust engineering solutions in line with build standards and data regulations, ensuring code is production ready
• have experience providing technical leadership for data engineering teams, setting priorities and direction while establishing best practice and knowledge gaps
• have significant practical experience developing production data solutions using Python and SQL, using Git-based workflows, code review and CI/CD practices to manage and deploy production code
• can demonstrate strong practical background of using Google Cloud, including technologies such as BigQuery, Dataform and Composer
• can work as part of a multidisciplinary team to plan and prioritise work, sometimes working independently and sometimes pairing with developers/data practitioners, and mentoring, coaching or supporting the development of other data engineers in the community