Senior Data Architect – Azure Databricks & Delta Lake Governance

E-Solutions

Exeter

On-site

GBP 90,000 - 120,000

Full time

12 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

E-Solutions is seeking an experienced Data Architect to lead large-scale data platform initiatives on Azure Databricks. You will design and implement medallion architectures (Bronze/Silver/Gold) with Delta Lake, configure Unity Catalog governance, and integrate diverse data sources.

The role requires strong Spark expertise, Data Lake Gen2, and Power BI connectivity, with onsite client work in the South West England region.

Qualifications

  • 8+ years of data architecture experience with at least 3 years hands-on with Azure Databricks in production environments.
  • Proven design and implementation experience with medallion architecture (Bronze/Silver/Gold) using Delta Lake on Databricks.
  • Strong hands-on Unity Catalog including metastore setup, catalog design, access controls and governance.
  • Experience configuring Azure Data Lake Storage Gen2 and integration with Databricks.
  • Hands-on with Microsoft Fabric and Power BI connectivity to Databricks SQL Warehouses.
  • Experience with MS SQL Server (on-premises/Azure) and Oracle ingestion into Azure landing zones.
  • Strong Spark skills (PySpark/Scala) and job scheduling in Databricks.
  • Ability to engage senior stakeholders and present findings in business terms.
  • UK-based with travel to client sites in South West England; onsite presence required.

Responsibilities

  • Design and implement scalable data architectures in Databricks environments.
  • Build and govern medallion architecture using Delta Lake across Bronze/Silver/Gold layers.
  • Configure and manage Unity Catalog governance, metastore, catalogs and schemas.
  • Set up and connect Azure Data Lake Storage Gen2 with Databricks and data pipelines.
  • Leverage Microsoft Fabric for data fabric connectivity to Databricks SQL Warehouses.
  • Integrate sources like MS SQL Server and Oracle into Azure landing zones and trust data quality.
  • Optimize Spark workloads (PySpark/Scala), partitioning, and scheduling for production jobs.
  • Present architectural findings to CIO/CDO and Architecture Council in business terms.
  • Coordinate onsite client work Weeks 1–2 and travel within South West England as needed.

Skills

Azure Databricks
Delta Lake
Unity Catalog
Azure Data Lake Storage Gen2
Microsoft Fabric
Power BI connectivity
Spark PySpark/Scala
SQL Server / Oracle ingestion

Tools

Azure Databricks UI/CLI
Power BI
Databricks Unity Catalog
Microsoft Fabric

Job description

E-Solutions is seeking an experienced Data Architect to lead large-scale data platform initiatives on Azure Databricks. You will design and implement medallion architectures (Bronze/Silver/Gold) with Delta Lake, configure Unity Catalog governance, and integrate diverse data sources.

The role requires strong Spark expertise, Data Lake Gen2, and Power BI connectivity, with onsite client work in the South West England region.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Architect — Azure Databricks & Delta Lake
Senior Data Architect — Azure Databricks & Delta Lake

Syncarp • Exeter

On-site
GBP 75,000 - 110,000
Senior Data Architect: Azure Databricks & Delta Lake
Senior Data Architect: Azure Databricks & Delta Lake

Sonata Software North America Inc. • Brentford

On-site
GBP 90,000 - 140,000
Azure Databricks Data Architect for Lakehouse Governance
Azure Databricks Data Architect for Lakehouse Governance

Sonata Software (SonataOne) • Brentford, Manchester

Hybrid
GBP 90,000 - 140,000
Senior Data Engineer — Azure, Databricks & Lakehouse
Senior Data Engineer — Azure, Databricks & Lakehouse

DCG (Poland) • United Kingdom

Remote
GBP 80,000 - 120,000
Private medical care
Co-financing for the sports card
Dedicated consultant support
Data Architect
Data Architect

Syncarp • Exeter

On-site
GBP 75,000 - 110,000
Data Architect
Data Architect

E-Solutions • Exeter

On-site
GBP 90,000 - 120,000
Data Engineer – Azure Databricks & Delta Lake (Hybrid)
Data Engineer – Azure Databricks & Delta Lake (Hybrid)

SSE Enterprise • Glasgow

Hybrid
GBP 36,000 - 54,000
Private healthcare
Cycle to Work scheme
Wellbeing programme
Senior Data Architect: Azure & Databricks Lakehouse (Remote)
Senior Data Architect: Azure & Databricks Lakehouse (Remote)

Ceox • Guildford

Remote
GBP 120,000 - 166,000
Senior Data Architect – Databricks & Azure, Hybrid
Senior Data Architect – Databricks & Azure, Hybrid

Computerworld Personnel Ltd • Portishead Point

Hybrid
GBP 72,000 - 88,000
Bonus Scheme
Hybrid Working
Life Assurance
+3
Hybrid Data Engineer: Azure Databricks & Delta Lake
Hybrid Data Engineer: Azure Databricks & Delta Lake

SSE Enterprise • Perth

On-site
GBP 36,000 - 54,000
Private healthcare discounts
Cycle to Work
Family entitlements