Senior Data Engineer: Lead Pipelines & Data Architecture

CDW LLC.; Greater London; Hybrid; GBP 90,000 - 130,000; Full time

Job summary

CDW is seeking a Senior Data Engineer to join the Enterprise Data team in London. The role focuses on ingesting, cleansing and modelling data into a single source of truth using Kimball datasets for BI, ML, DS & AI.

You will lead data engineering activities, guide a team of data engineers, and ensure high-quality data pipelines, governance and collaboration across IT and business.

Qualifications

• 7+ years in a data engineering role.

Responsibilities

• Design and develop homogeneous data repositories to enable data-driven decisions.
• Ingest data from diverse sources including SQL databases, REST APIs and Kafka.
• Define cleansing rules to meet quality expectations.
• Model data for single source of truth Kimball datasets (dimensions/facts).
• Apply DevOps: CI/CD, testing, code reviews, and documentation.
• Monitor pipelines for data quality and timeliness; implement reactive changes.
• Lead backlog refinement, sprint planning, and technical requirement translation.

Skills

Azure data engineering

PySpark

Python

SQL

Data modelling (Kimball)

CI/CD practices

Data governance

Tools

Azure Data Factory V2

Azure Data Lake Storage V2

Azure Databricks

Azure Function Apps & Logic Apps

Azure Stream Analytics

Terraform

Azure Resource Manager

Job description

CDW is seeking a Senior Data Engineer to join the Enterprise Data team in London. The role focuses on ingesting, cleansing and modelling data into a single source of truth using Kimball datasets for BI, ML, DS & AI.

You will lead data engineering activities, guide a team of data engineers, and ensure high-quality data pipelines, governance and collaboration across IT and business.