Lead Data Engineer London McCabe & Barton Full time

McCabe & Barton; London; Hybrid; GBP 110,000; Full time

Job summary

A leading Global Technology Consultancy in London is seeking a Lead Data Engineer to join their team. This role involves transforming raw data into actionable insights, utilizing advanced data tools and cloud platforms. The ideal candidate will have extensive experience in data engineering, strong problem-solving skills, and the ability to work in a client-facing environment. This position offers a competitive salary, bonus, and the flexibility of a hybrid working model.

Qualifications

• Experience from an IT Technology provider or IT Consultancy.
• Client-facing experience across sectors like banking, healthcare, and retail.
• Strong experience with big data tools and cloud platforms.

Responsibilities

• Transform raw data into insights, ensuring performance and compliance.
• Design scalable, fault-tolerant data architectures.
• Mentor engineers and enforce best practices.

Skills

Python

SQL

Scala

Java

Apache Spark

Hadoop

Databricks

Dask

AWS

Azure

GCP

Docker

Kubernetes

Terraform

CI/CD

Job description

A leading Global Technology Consultancy in the City of London is now looking for a Lead Data Engineer to join the business on a permanent basis. The role offers a base salary of £110,000 (potential flexibility), plus bonus and shares. Their HQ is in the City of London, and they have adopted a hybrid working model.

The ideal Lead Data Engineer will have a background from either an IT Technology provider or IT Consultancy and enjoy working with clients to solve real-world data problems. In this exciting role, you'll partner with clients to transform raw data into powerful insights, ensuring top-tier performance, reliability, and compliance with data governance standards. The Lead Data Engineer should be well-versed in the latest Data Tools / Gen AI and capable of utilizing them to deliver high-quality solutions that align with client objectives.

To be considered for this role, you will need experience in some of the following areas:

1. Experience from either an IT Technology provider or IT Consultancy background.
2. Thrives working in a client-facing environment with a proven track record across sectors including banking, insurance, healthcare, media, retail, infrastructure, and telco.
3. Expertise in some of the following: Python, SQL, Scala, and Java for data engineering.
4. Strong experience with big data tools (Apache Spark, Hadoop, Databricks, Dask) and cloud platforms (AWS, Azure, GCP).
5. Proficiency in data modelling (relational, NoSQL, dimensional) and DevOps automation (Docker, Kubernetes, Terraform, CI/CD).
6. Ability to design scalable, fault-tolerant data architectures with a focus on security and compliance, including RBAC, encryption, and auditing best practices.
7. Strong problem-solving skills to debug and optimize data pipelines, with experience in mentoring engineers and enforcing best practices.
8. Note: This role involves some European travel.

If you are an experienced Lead Data Engineer with the required skills, please respond to this ad with an up-to-date version of your CV for review.