Senior Data Engineer – Insurance Sector

Stott and May; City Of London; Hybrid; GBP 85,000 - 100,000; Full time

Job summary

A leading recruitment agency is seeking a Senior Data Engineer to join a growing data team in London. This hybrid role focuses on designing scalable data solutions for the insurance sector. The ideal candidate has expertise in Azure, Databricks, and Python, and a passion for solving complex data challenges. This is an opportunity to make a tangible impact while shaping the future of data engineering.

Qualifications

• Proven experience building and optimising data solutions in large, complex environments.
• Hands-on expertise in Azure, Databricks, Python.
• Experience working with Lloyd’s Syndicate and specialty insurance data sets.

Responsibilities

• Partnering with analysts and product owners to turn business needs into scalable data solutions.
• Designing and maintaining robust data pipelines and models for analytics and reporting.
• Mentoring junior engineers and contributing to the team’s technical roadmap.

Skills

Data solutions

Data pipelines

Azure

Databricks

Python

Collaboration

Tools

Azure DevOps

Unity Catalog

SQL

Job description

Overview

Senior Data Engineer – Insurance Sector

Location: Hybrid (London-based with flexible working)
Salary: £85K -£100K – this is dependent on skills and experience

Join a growing data team that’s transforming how the insurance industry uses data to make smarter, faster decisions. As a Senior Data Engineer, you’ll design and deliver scalable, high-performing data solutions that power analytics, reporting, and risk insights across the business.

You’ll work closely with analysts, actuaries, and underwriters to build pipelines, models, and architectures that bring structure, speed, and accuracy to complex insurance data. This is a fantastic opportunity to make a real impact while shaping the future of data engineering within a forward-thinking organisation.

What You’ll Be Doing

• Partnering with analysts and product owners to turn business needs into scalable data solutions.
• Designing and maintaining robust data pipelines and models for analytics and reporting.
• Applying best practices in data architecture, security, and performance.
• Working with modern tools including Azure, Databricks, Python, Azure DevOps, Unity Catalog, and SQL.
• Supporting data governance through cataloguing, lineage, and compliance frameworks.
• Mentoring junior engineers and contributing to the team’s technical roadmap.

What You’ll Bring

• Proven experience building and optimising data solutions in large, complex environments.
• Hands-on expertise in Azure, Databricks, and Python, with a strong grasp of modern data architectures.
• Experience working with Lloyd’s Syndicate and specialty insurance data sets, including data structures, lineage, and compliance nuances.
• Strong communication skills and a passion for collaboration and continuous improvement.

If you’re driven by solving complex data challenges and want to make a tangible impact within the insurance sector — this is the role for you.