Databricks Solution Architect

TechClover; Greater London; On-site; GBP 90,000 - 140,000; Full time

Job summary

TechClover is seeking a Principal Data Architect to lead the design and implementation of modern lakehouse architectures built on the Databricks platform. You will work directly with C-level stakeholders, shaping enterprise data strategy and architecting scalable, cloud-native solutions powered by Databricks.

You will oversee end-to-end architecture and delivery across Azure, AWS, and GCP, applying Delta Lake, Unity Catalog, DLT, and Databricks Workflows to support BI, AI, ML, and Generative AI

Qualifications

• 8+ years in Data Engineering, Data Architecture, or Cloud Data Platforms.
• Strong hands-on expertise with the Databricks Data Intelligence Platform.
• Deep knowledge of Delta Lake, Unity Catalog, Delta Live Tables, Databricks Workflows, MLflow, Databricks SQL, Spark & Structured Streaming.

Responsibilities

• Lead end-to-end architecture and delivery of enterprise Databricks Lakehouse solutions.
• Design scalable, secure data platforms on Databricks across Azure, AWS, and GCP.
• Architect data models for BI, AI, ML, and Generative AI use cases.
• Define data governance, security, lineage, and access control.
• Build scalable batch and streaming architectures with Spark.

Skills

Databricks

Data Architecture

Delta Lake

Unity Catalog

DLT (Delta Live Tables)

Spark (PySpark/Scala)

GCP/AWS/Azure

Governance & Security

Stakeholder Management

Pre-sales & Architecture Leadership

Tools

Databricks Platform

MLflow

Apache Spark

dbt

Kafka

Job description

We are partnering with a fast-growing, high-impact Data & AI consulting firm delivering enterprise-scale transformation for Fortune 1000 clients through the Databricks Data Intelligence Platform.

As a Principal Data Architect, you will lead the design and implementation of modern lakehouse architectures, enabling organizations to unlock the full potential of their data and AI investments.

You will work directly with C-level stakeholders, shape enterprise data strategy, and architect scalable, cloud-native solutions powered by Databricks.

What You'll Do

• Lead end-to-end architecture and delivery of enterprise Databricks Lakehouse solutions.
• Design scalable, secure, and high‑performance data platforms on Databricks across Azure, AWS, and GCP.
• Architect modern data solutions using Delta Lake, Unity Catalog, Delta Live Tables (DLT), and Databricks Workflows.
• Design enterprise data models supporting BI, AI, ML, and Generative AI use cases.
• Define data governance, security, lineage, and access control using Unity Catalog.
• Build scalable batch and streaming architectures leveraging Apache Spark and Structured Streaming.
• Drive performance optimization, workload tuning, cluster sizing, and cost optimization within Databricks.
• Establish enterprise data architecture standards, best practices, and governance frameworks.
• Partner with business stakeholders to translate business challenges into scalable technical solutions.
• Mentor architects and engineering teams on Databricks architecture and modern data engineering practices.
• Support solutioning, client workshops, RFP/RFI responses, pre‑sales activities, and executive presentations.
• Stay at the forefront of Databricks innovations, AI capabilities, and emerging Lakehouse architecture trends.

What We're Looking For

• 8+ years of experience in Data Engineering, Data Architecture, or Cloud Data Platforms.
• Strong hands‑on expertise with the Databricks Data Intelligence Platform.
• Deep knowledge of: Delta Lake, Unity Catalog, Delta Live Tables (DLT), Databricks Workflows, MLflow, Databricks SQL, Apache Spark (PySpark/Scala) and Structured Streaming
• Strong understanding of Medallion Architecture (Bronze, Silver, Gold).
• Experience integrating Databricks with cloud services across Azure, AWS, or GCP.
• Expertise in data governance, metadata management, security, and data quality frameworks.
• Experience supporting AI/ML and Generative AI workloads on Databricks.
• Consulting experience working with enterprise clients across multiple industries.
• Excellent stakeholder management, presentation, and communication skills.
• Experience leading architecture discussions with senior business and technology leaders.

Preferred

• Databricks Certified Solution Architect
• Experience with Unity Catalog implementation
• Experience building AI/ML solutions using MLflow and Mosaic AI
• Experience with dbt, Kafka, Airflow, or Fivetran
• Experience with Snowflake or Microsoft Fabric integration
• Exposure to RAG, Vector Search, and Agentic AI architectures on Databricks

Why This Role

• Lead enterprise Databricks transformation programs for Fortune 1000 clients.
• Architect cutting‑edge AI, analytics, and Lakehouse platforms.
• Work alongside Databricks experts and senior technology leaders.
• Influence strategic client decisions and large‑scale digital transformation initiatives.
• Join a high‑growth consulting firm at the forefront of Data, AI, and Cloud innovation

If Interested?

Apply now or reach out to [e-mail] directly for a confidential discussion.

Only shortlisted candidate will be notified.