Senior Data Engineer — Azure Lakehouse & Analytics

ARC IT Recruitment; Glasgow; On-site; GBP 90,000 - 115,000; Full time

Job summary

ARC IT Recruitment is seeking a Senior Data Engineer to join a leading London-based insurance organisation.

In a high-impact data team you will build and evolve a modern Azure-based Data Lakehouse, supporting underwriting insight, analytics and decision making at scale.

You will work closely with senior business stakeholders, regional data teams and IT, combining hands-on engineering with input into solution design, standards and best practices.

Qualifications

• Experience in data engineering within a Lakehouse or modern data platform environment.
• Proven experience building ELT pipelines and integrating complex data sources.
• Hands-on expertise with Azure Data Factory, Azure Databricks, Azure Storage and Azure DevOps.
• Advanced Python and SQL skills.
• Experience designing data models (including star schema) for Power BI or similar reporting tools.
• Experience within insurance, MGA or financial services environments is highly desirable.
• Excellent communication skills with the ability to work confidently across technical and non-technical teams.

Responsibilities

• Engineer and enhance enterprise-wide data platforms, with a core focus on the Group Data Lakehouse.
• Design, build, test and deploy scalable data pipelines and data products.
• Ensure strong governance across data quality, security, change control and documentation.
• Collaborate with regional data teams to maintain consistent data models and standards.
• Support underwriting analytics and reporting teams to ensure data accuracy and usability.
• Work alongside data science teams to productionise machine learning pipelines.
• Contribute to DevOps and CI/CD practices within an agile delivery model.
• Act as a trusted technical partner, advising on data engineering best practice and solution design.

Skills

Azure Data Factory

Azure Databricks

Azure Storage

Azure DevOps

Python

SQL

Star Schema

Power BI

Data Lakehouse

ELT pipelines

Job description

ARC IT Recruitment is seeking a Senior Data Engineer to join a leading London-based insurance organisation.

In a high-impact data team you will build and evolve a modern Azure-based Data Lakehouse, supporting underwriting insight, analytics and decision making at scale.

You will work closely with senior business stakeholders, regional data teams and IT, combining hands-on engineering with input into solution design, standards and best practices.