Data Engineer, Azure

ARC IT Recruitment; Glasgow; On-site; GBP 90,000 - 115,000; Full time

Job summary

ARC IT Recruitment is seeking a Senior Data Engineer to join a leading London-based insurance organisation.

In a high-impact data team you will build and evolve a modern Azure-based Data Lakehouse, supporting underwriting insight, analytics and decision making at scale.

You will work closely with senior business stakeholders, regional data teams and IT, combining hands-on engineering with input into solution design, standards and best practices.

Qualifications

• Experience in data engineering within a Lakehouse or modern data platform environment.
• Proven experience building ELT pipelines and integrating complex data sources.
• Hands-on expertise with Azure Data Factory, Azure Databricks, Azure Storage and Azure DevOps.
• Advanced Python and SQL skills.
• Experience designing data models (including star schema) for Power BI or similar reporting tools.
• Experience within insurance, MGA or financial services environments is highly desirable.
• Excellent communication skills with the ability to work confidently across technical and non-technical teams.

Responsibilities

• Engineer and enhance enterprise-wide data platforms, with a core focus on the Group Data Lakehouse.
• Design, build, test and deploy scalable data pipelines and data products.
• Ensure strong governance across data quality, security, change control and documentation.
• Collaborate with regional data teams to maintain consistent data models and standards.
• Support underwriting analytics and reporting teams to ensure data accuracy and usability.
• Work alongside data science teams to productionise machine learning pipelines.
• Contribute to DevOps and CI/CD practices within an agile delivery model.
• Act as a trusted technical partner, advising on data engineering best practice and solution design.

Skills

Azure Data Factory

Azure Databricks

Azure Storage

Azure DevOps

Python

SQL

Star Schema

Power BI

Data Lakehouse

ELT pipelines

Job description

Senior Data Engineer is required to join a leading London-based insurance organisation with offices in the heart of the city. Working within a high-impact, specialist data team this role will see you building and evolving a modern Azure-based Data Lakehouse, supporting underwriting insight, analytics and decision-making at scale.

You will work closely with senior business stakeholders, regional data teams and IT, combining hands-on engineering with input into solution design, standards and best practice.

Key Responsibilities

• Engineer and enhance enterprise-wide data platforms, with a core focus on the Group Data Lakehouse
• Design, build, test and deploy scalable data pipelines and data products
• Ensure strong governance across data quality, security, change control and documentation
• Collaborate with regional data teams to maintain consistent data models and standards
• Support underwriting analytics and reporting teams to ensure data accuracy and usability
• Work alongside data science teams to productionise machine learning pipelines
• Contribute to DevOps and CI/CD practices within an agile delivery model
• Act as a trusted technical partner, advising on data engineering best practice and solution design

Skills and experience

• Strong background in data engineering within a Lakehouse or modern data platform environment
• Proven experience building ELT pipelines and integrating complex data sources
• Hands-on expertise with Azure Data Factory, Azure Databricks, Azure Storage and Azure DevOps
• Advanced Python and SQL skills
• Experience designing data models (including star schema) for Power BI or similar reporting tools
• Experience within insurance, MGA or financial services environments is highly desirable
• Excellent communication skills with the ability to work confidently across technical and non-technical teams