Data Engineer

Pioneer Search; City Of London; Hybrid; GBP 85,000 - 100,000; Full time

Job summary

A leading (re)insurance business in the Lloyd's market seeks a Data Engineer to enhance their data capabilities as part of a significant transformation. The role involves building scalable data pipelines and working with modern architectures like Databricks and Azure. The successful candidate will collaborate across teams to deliver impactful solutions in a hybrid cloud environment.

Qualifications

• Strong hands-on experience with Azure Data Factory.
• Solid understanding of hybrid cloud/on-prem environments.

Responsibilities

• Enhance & maintain a Lakehouse architecture using Medallion principles.
• Collaborate with stakeholders across Underwriting, Actuarial, & Finance.
• Support DevOps practices & CI/CD workflows in Azure.

Skills

Azure Data Factory

Data pipeline development

Cloud and on-prem environments

Tools

Databricks

PySpark

Job description

Social network you want to login/join with:

Location: London (Hybrid)
Salary: £85,000 + Bonus + Benefits
Type: Permanent

A Data Engineer is required for a fast-evolving (re)insurance business at the heart of the Lloyd's market, currently undergoing a major data transformation. With a strong foundation in the industry & a clear vision for the future, they're investing heavily in their data capabilities to build a best-in-class platform that supports smarter, faster decision-making across the business.

As part of this journey, they're looking for a Data Engineer to join their growing team. This is a hands-on role focused on building scalable data pipelines & enhancing a modern Lakehouse architecture using Databricks, PySpark, & Azure. The environment is currently hybrid cloud & on-prem, with a strategic move towards Microsoft Fabric-so experience across both is highly valued.

What you'll be doing:

• Enhance & maintain a Lakehouse architecture using Medallion principles
• Working across both cloud & on-prem environments, supporting the transition to Microsoft Fabric.
• Collaborating with stakeholders across Underwriting, Actuarial, & Finance to deliver high-impact data solutions.
• Support DevOps practices & CI/CD workflows in Azure

Technical Requirements:

• Strong hands-on experience with:
• Azure Data Factory for data integration
• Solid understanding of:
• Hybrid cloud/on-prem environments
• Exposure to or interest in:
• Microsoft Fabric & its evolving role in enterprise data platforms
• Experience in Financial Services or Lloyd's market is a plus