Senior Databricks Data Architect & Platform Lead

UNISON Group; Greater London; On-site; GBP 120,000 - 180,000; Full time

Job summary

UNISON Group is seeking a Lead Solution Architect – Data Engineering to own end-to-end architecture on Databricks engagements, ensuring secure, scalable platforms and governance. You will lead migrations, guide presales, and mentor engineers, shaping accelerators and reusable assets.

You bring 12+ years in data engineering, 3+ years on Databricks at enterprise scale, and strong Python/SQL/Scala skills, with a track record in cloud transformations and presales success.

Qualifications

• 12+ years in data engineering and architecture.
• 3+ years on Databricks at enterprise scale.
• Strong Python/SQL/Scala and CI/CD for data platforms.
• Experience migrating on-prem to cloud across Azure/AWS/GCP.
• Presales experience with solutioning and proposals.
• Databricks Data Engineer Professional / SA accreditations preferred.

Responsibilities

• Own end-to-end architecture and design decisions on Databricks engagements.
• Lead production-grade data platforms — ingestion, transformation, governance through Unity Catalog, and downstream BI/ML enablement.
• Lead large-scale migrations and cloud transformation projects to Databricks on Azure/AWS/GCP.
• Stay hands-on: performance tuning, code and design reviews, and setting engineering standards.

Skills

Databricks

Data engineering

Python

SQL

Scala

CI/CD

Presales

Architecture

Tools

Databricks

Unity Catalog

Delta Lake

Airflow

MLflow

DLT/Lakehouse

Workflows

OpenAI API

Anthropic API

Job description

UNISON Group is seeking a Lead Solution Architect – Data Engineering to own end-to-end architecture on Databricks engagements, ensuring secure, scalable platforms and governance. You will lead migrations, guide presales, and mentor engineers, shaping accelerators and reusable assets.

You bring 12+ years in data engineering, 3+ years on Databricks at enterprise scale, and strong Python/SQL/Scala skills, with a track record in cloud transformations and presales success.