Lead Data Engineer

VIQU Ltd; Greater Manchester; Hybrid; GBP 85,000 - 95,000; Full time

Job summary

A national organisation in the UK is seeking a Lead Data Engineer to drive the transformation of their data infrastructure. This role involves a balance of technical engineering and leadership, requiring hands-on experience with Google Cloud Platform (GCP). Responsibilities include leading the architecture and engineering strategy for data teams, conducting data engineering work using Python and SQL, and mentoring team members. Candidates must possess a strong background in managing data professionals and designing data platforms within GCP.

Qualifications

• Experience line managing teams of data professionals.
• Hands on skills across the GCP tech stack, SQL and Python.
• Deep understanding of Data Mesh and Data Lake/Warehouse solutions.

Responsibilities

• Lead the architecture and engineering strategy of data squads.
• Hands on data engineering work, using Python and SQL.
• Mentor and lead teams, checking and reviewing code.

Skills

Team management

GCP experience

Data modeling

SQL

Python

Tools

Airflow

Big Query

Data Flow

Data Fusion

Data Stream

Job description

Overview

Role: Lead Data Engineer

Salary: £85,000 - £95,000 per annum

Location: Manchester (Remote/Hybrid)

VIQU have partnered with a national organisation going through an exciting transformation in their data infrastructure and so are hiring a lead data engineer to lead the design of their platform within the Google Cloud Platform (GCP). The role will involve an even split of technical engineering, architecture and leadership/people management. Due to the seniority of this role, candidates must have hands on experience with GCP.

Requirements

• Experience line managing teams of data professionals.
• Prior experience designing data platform(s) within GCP, working hands on with; Airflow, Big Query, Data Flow, Data Fusion, and Data Stream.
• Deep understanding of Data Mesh/decentralised design and Data Lake/Warehouse solutions.
• Hands on skills across the GCP tech stack, SQL and Python.
• Ability to lead cultural change across organisations, and manage senior stakeholders.
• Ability to work across multiple contexts and teams.

Responsibilities

• Lead the architecture, best practise and engineering strategy of data squads.
• Hands on data engineering work, utilising both python and SQL.
• Mentor and lead teams of engineers, checking and reviewing code, and setting standards.
• Ensure all data platform processes; including ingestion, quality, transformation, security, batch management, monitoring, alerting, and cost control are efficient.
• Design and help build the data platform - ensuring data is processed through semantic layers and can be modelled effectively.
• Lead changes across the organisation, adopting a decentralised design.