Lead Databricks Migration Architect for Insurance Data

Collage Recruitment; Greater London; Hybrid; GBP 90,000 - 140,000; Full time

Job summary

Collage Recruitment advertises a Lead Data Architect for Insurance Data & Analytics in London. The role centers on migrating a legacy benchmarking engine to a modern Databricks Lakehouse and building product tooling on top of it.

You will own the UK data platform, drive CI/CD and IaC, and mentor engineers while collaborating with global teams on platform standards. This is a senior leadership technical role with direct impact on data products.

Qualifications

• Experience delivering Databricks migration at production scale.
• Strong skills in Python, PySpark and SQL.
• Track record migrating SQL Server workloads to cloud-native platforms.

Responsibilities

• Lead migration of legacy SQL to Databricks pipelines and orchestrations.
• Define target-state data architecture (Lakehouse, Medallion).
• Codify canonical metric logic with testable code.
• Own Unity Catalog governance: schema, tables, access control.

Skills

Databricks migration

Python

PySpark

SQL

Stakeholder management

CI/CD

Infrastructure as Code

Performance tuning

Data governance

Tools

Databricks

Unity Catalog

dbt

Job description

Collage Recruitment advertises a Lead Data Architect for Insurance Data & Analytics in London. The role centers on migrating a legacy benchmarking engine to a modern Databricks Lakehouse and building product tooling on top of it.

You will own the UK data platform, drive CI/CD and IaC, and mentor engineers while collaborating with global teams on platform standards. This is a senior leadership technical role with direct impact on data products.