Data Engineer — AI-Driven Pipelines on Microsoft Fabric

Willis Towers Watson; Greater London; Hybrid; GBP 60,000 - 90,000; Full time

Benefits offered by this job

25 days leave

Private healthcare

Life insurance

Pension matched 10%

Hybrid work

Volunteer day

Car scheme

Job summary

Willis Towers Watson is seeking a Data Engineer to design, build and optimize data pipelines using Microsoft Fabric, Azure Synapse, and Data Factory. You will develop PySpark notebooks, manage Data Lakes, and integrate AI/LLM models and Copilot agents into data workflows.

You’ll collaborate with data experts, AI engineers and business teams to deliver scalable, compliant data solutions across cloud platforms, while enjoying hybrid work options and opportunities for growth.

Qualifications

• Solid hands-on Data Engineering experience with cloud data tools, especially Microsoft Fabric.
• Strong Python programming skills and data pipeline design experience.
• Knowledge of data warehousing, modeling, and basic data architecture.
• Experience debugging complex data issues and collaborating cross-functionally.

Responsibilities

• Design, build, and optimize data pipelines using Microsoft Fabric, Azure Synapse, Data Factory, and Fabric.
• Develop and tune PySpark notebooks for large-scale data workloads.
• Implement and improve ETL/ELT workflows in Azure Synapse and Fabric.
• Manage Data Lakes for high performance and easy access to data.
• Integrate AI/LLM models and Copilot agents into data pipelines and processes.
• Validate AI-enabled solutions, document issues, and escalate risks when needed.
• Create automation workflows with Power Automate and Power Platform.
• Collaborate with business teams and AI engineers to deliver data-driven solutions.
• Support data security, governance, and compliance in Azure and Fabric.

Skills

Python

Azure

Microsoft Fabric

PySpark

ETL/ELT

APIs

Data Lakes

Power Platform

Education

Bachelor's degree

Tools

Azure Data Factory

Azure Synapse

Power BI

Databricks

REST APIs

Job description

Willis Towers Watson is seeking a Data Engineer to design, build and optimize data pipelines using Microsoft Fabric, Azure Synapse, and Data Factory. You will develop PySpark notebooks, manage Data Lakes, and integrate AI/LLM models and Copilot agents into data workflows.

You’ll collaborate with data experts, AI engineers and business teams to deliver scalable, compliant data solutions across cloud platforms, while enjoying hybrid work options and opportunities for growth.