Senior Data Engineer

RELX; Greater London; On-site; GBP 60,000 - 80,000; Full time

Job summary

A leading data solutions provider in the UK seeks a Senior Data Engineer to enhance existing data assets and design efficient data pipelines. The ideal candidate will utilize Microsoft Fabric and Python to integrate diverse data sources while collaborating closely with stakeholders. This role is pivotal in enabling reliable data products that support analytics and AI-driven solutions across the organization.

Qualifications

• Experience with data integration from internal and external sources.
• Ability to maintain and enhance data pipelines and workflows.
• Knowledge of API integration and cloud technology.

Responsibilities

• Design, build, and manage ingestion pipelines in Microsoft Fabric.
• Maintain and enhance existing Fabric data assets.
• Integrate data from various sources including APIs and databases.

Skills

Data integration

Python programming

Data engineering practices

Collaboration with stakeholders

Tools

Microsoft Fabric

Cloud data platforms

Job description

Job Description

About the role : The Senior Data Engineer will maintain and enhance a wide range of existing Fabric assets including pipelines, dataflows, notebooks, Lakehouse tables, and Warehouse objects, while proactively identifying opportunities to introduce new, more scalable, and more efficient data engineering practices. This role is central to enabling high-quality, reliable data products that support analytics, automation, and AI-driven solutions across the organisation.

The ideal candidate will be experienced in integrating diverse internal and external data sources, collaborating with stakeholders, and ensuring the availability of trusted, high-performance datasets for downstream consumers.

Responsibilities

• Design, build, and manage ingestion pipelines in Microsoft Fabric for structured and unstructured data, aligned to the Bronze and Silver layers of the Medallion Architecture.
• Maintain and enhance existing Fabric data assets while identifying opportunities to introduce improved patterns, automation, and modern engineering practices.
• Integrate data from internal and external APIs, SFTP endpoints, on-premise databases, and cloud data platforms.
• Use Python extensively within Fabric notebooks for data processing, API integration, automation, and advanced transformation logic.

Develop and maintain Fabric Dat...