Senior Data Engineer

CDW; Greater London; On-site; GBP 90,000 - 130,000; Full time

Job summary

CDW is looking for a Senior Data Engineer to lead data engineering activities for our Data Platforms and Services. You will ingest, cleanse and model data to support BI reporting, ML, DS and AI

You will lead data engineers, drive data governance, and ensure GDPR compliance while delivering robust pipelines in a hybrid London office.

Qualifications

• At least 7 years as an Engineer in a Data Field.
• Strong Azure data skills across ADF, ADLS, Databricks and associated tech.
• Proficient Python, PySpark, SQL and data modeling (Kimball).
• Experience with unit/integration testing (unittest, pytest).
• Knowledge of GDPR/data governance and data quality practices.

Responsibilities

• Design and develop data repositories to enable data-led decisions.
• Ingest data from varied sources (on-prem SQL, REST APIs, Kafka).
• Apply data cleansing rules to ensure quality.
• Model data for single source of truth (Kimball).
• Implement CI/CD and maintain code quality via tests and reviews.
• Monitor pipelines to ensure timeliness and data quality.
• Lead backlog refinement, sprint planning, demos and retrospectives.

Skills

SQL

Data analysis

Python

Testing (unit/integration)

DevOps practices

Tools

Azure Data Factory

Azure Data Lake Storage

Azure Databricks

Azure Function Apps & Logic Apps

Azure Stream Analytics

Terraform

Azure Portal / Az CLI / Az PowerShell

PySpark

Delta Lake

Unity Catalog

Python

unittest / pytest

CI/CD

Job description

At CDW, we make it happen, together. Trust, connection, and commitment are at the heart of how we work together to deliver for our customers. It’s why we’re coworkers, not just employees. Coworkers who genuinely believe in supporting our customers and one another. We collectively forge our path forward with a level of commitment that speaks to who we are and where we’re headed. We’re proud to share our story and Make Amazing Happen at CDW.

JOB TITLE:

Senior Data Engineer

DEPARTMENT:

Enterprise Data

LOCATION:

One New Change, London, EC4M 9AF

SHIFT PATTERN:

Monday to Friday, 09:00-17:30 - Hybrid working (3 days in Office per week)

RESPONSIBLE FOR:

Leading (and carrying out) Data Engineering activities for and not limited to the Data Platforms and Services

BACKGROUND:

CDW is a leading technology solutions provider to business, government, education and healthcare organisations in the United Kingdom, Canada, and the United States. Our fingerprints can be found on technology in workplaces of more than 250,000 companies: from start-ups to international conglomerates. With the breadth of products and services we offer, there is no request too big or too small.

CDW prides itself on being ‘People Who Get IT’ and ‘People who get People’. Our relationships are fuelled by our deep expertise and grounded in the CDW Way. Our empowering leadership makes things happen and inspires their teams to do the same. From the teammates beside us to the leaders who guide us, we move forward together. At CDW, you’ll work with people who inspire you. People with positive, success-driven attitudes who you will learn from and forge strong relationships with. Bring your best true self—and your best ideas to CDW. Because diverse perspectives bring forth better problem solving—and better solutions for our customers on a rapidly evolving technology landscape.

KEY DUTIES:

CDW is constantly evolving our Data and technology landscape and are looking for a Senior Data Engineer to join a growing team to ingest, cleanse and model data into single source of truth, Kimball datasets, used for Business Intelligence reporting, ML, DS & AI and more.

A Senior Data Engineer to manage, lead, guide, advice and develop technology and people.

Responsible to lead the work, activities, oversight and management of Data Engineers reporting into this role.

• Design and develop homogenous data repositories to deliver data led decision making.
• Ingest data from various sources, including on premise SQL databases, REST API’s, Apache Kafka streams, etc.
• Define and apply cleansing rules to the data to ensure meets quality expectations.
• Define and model data for its appropriate use including into single source of truth Kimball datasets, e.g. dimensions and facts.
• DevOps approach to software; create high quality code using traditional software practices, such as building, linting, unit and integration testing, repositories, CI/CD, peer reviews, etc.
• DevOps approach to support; monitor pipelines to ensure business-critical data pipelines are processed meeting time constraint and data quality expectations (including implementing reactive changes where applicable).
• Drive and Integrate into the data team’s WOW, including backlog refinement, sprint planning, demonstrations, and retrospectives, including translation of user requirements into technical requirements including complexity estimation, implement into sprint cycles, collaboration into process improvement, etc.
• Based on requirements, perform ad-hoc analysis of structured and unstructured data across multiple data sources to inform solution design.
• Document datasets in data catalogue, including ownership, stewardship, dictionaries, glossaries, lineage, sensitivity, etc.
• Ownership of Work Items and works with data owners / stewards to ensure high quality, aligned deliveries, and compliance with legislation, such as GDPR, e.g. PII vs Non-PII, data retention, etc.
• Document solution design inline with Data Governance.
• Support all data platforms and ensure its smooth running.
• Ad-hoc Analysis: Perform ad-hoc analysis of structured and unstructured data to inform solution design and support decision-making processes.

KNOWLEDGE AND EXPERIENCE:

Must Have

• At least 7 years as an Engineer in a Data Field
• Strong Azure data skills, including:
• Azure Data Factory V2
• Azure Data Lake Storage V2
• Azure Databricks
• Azure Function Apps& Logic Apps
• Azure Stream Analytics
• Azure Resource Manager skills (Terraform, Azure Portal, Az CLI and Az PowerShell)
• Strong PySpark, Delta Lake, Unity Catalog and Python skills.
• Includes ability to write unit and integration tests in Python with unittest, pytest, etc.
• Strong understanding of software development practices, such as SOLID principals, structuring code, testing, IOC, etc.
• Strong repositories, CI/CD skills.
• Strong knowledge of Kimball data modelling, such as star schema, snowflake, etc.
• Strong SQL skills.
• Strong data analysis skills.
• Excellent written and verbal communication skills
• A demonstrable track record of getting stuff done whilst managing competing pressures and deadlines and retaining an eye for detail and quality.
• A passion for technology and its ability to have a positive impact on business.

Nice To Have:

• Azure DevOps (git, multistage YAML, etc.)
• Other languages, such as C#, PowerShell
• IaC, e.g. Terraform, ARM, Bicep, etc.
• Test driven development (TDD)
• Streaming technologies, such as Azure Stream Analytics, Spark Structured Streaming, etc.
• Power BI Engineering experience
• Certified SCRUM Developer (CSD)
• Data Governance tool experience e.g. Purview
• Machine learning and Artificial intelligence

CDW is committed to being an AI-fluent organization

We’re looking for people who bring curiosity, a learner’s mindset, and a willingness to engage with ever-evolving technology and tools. We value adopting AI as a partner, openness to experimentation, and a shared interest in learning together on AI. Our goal is to create a culture where AI enhances—not replaces—human creativity and decision-making. You don’t need to be an expert today; what matters is your readiness to explore, adapt, and grow with us as we integrate AI responsibly and effectively into our work.

Additionally, CDW is committed to fostering an equitable, transparent, and respectful hiring process for all applicants. During our application process, our goal is to understand your experience, strengths, skills, and qualifications. As an AI forward company, we see AI not just as a tool, but as a catalyst for new ways of thinking, creating, and communicating. We encourage candidates to embrace an AI mindset, one that’s curious, adaptive, and ready to explore what’s possible. We welcome thoughtful use of AI to expand your perspective and elevate how you share your story, while ensuring your application remains rooted in your own background, judgment, and voice.

About Us

CDW is a Fortune 500 technology solutions provider that helps businesses, government, education, and healthcare organizations achieve what’s possible through technology. What makes CDW different isn’t just what we do—it’s how we do it. At CDW we act as one—building trust, speaking candidly, and working together to achieve more. We play to win—focusing on what matters most and delivering for our customers. And we think forward—staying curious, moving fast, and continuously learning. We believe meaningful work happens when people feel supported, heard, and empowered to contribute. That’s why we think of ourselves as coworkers, not just employees—working together to solve complex challenges and deliver real impact for our customers and communities.

As a full-stack, full-lifecycle technology partner, CDW brings deep expertise, strong relationships, and broad industry knowledge to help turn ideas into outcomes. When you join CDW, you become part of a collaborative environment where your work matters, your growth is supported, and your contributions help shape what’s next.

Together, we deliver the full promise of what technology can do. Together, we Make Amazing Happen.

CDW is an equal opportunity employer. All qualified applicants will receive consideration for employment without regards to race, color, religion, sex, sexual orientation, gender identity, national origin, disability status, protected veteran status or any other basis prohibited by state and local law.