Technology Architect - Databricks

N Consulting Limited; Greater London; Hybrid; GBP 80,000 - 100,000; Full time

Job summary

N Consulting Limited is seeking a Technology Architect with deep expertise in Databricks to lead data engineering and cloud transformation initiatives. The ideal candidate will have over 12 years of experience and will be responsible for defining scalable architectural solutions and guiding engineering teams.

The role focuses on designing data platforms using Databricks Lakehouse architecture and optimizing ETL pipelines. Ideal candidates are expected to evaluate technologies and implement best practices while ensuring data governance.

This is a hybrid role with 3 days in the office per week.

Qualifications

• Over 12 years of experience in data engineering and cloud transformation initiatives.
• Deep expertise in Databricks and big data architectures.
• Experience in developing reference architectures and solution blueprints.

Responsibilities

• Define end to end architectural solutions for data platforms.
• Guide teams to implement performance optimization strategies.
• Evaluate and recommend architectural improvements and new tools.

Skills

Databricks

Big Data Architectures

Azure

Data Engineering

PySpark

Spark SQL

ETL/ELT Pipelines

Job description

# Technology Architect - Databricks at N Consulting LtdWork mode: Hybrid Number of days a week worked in the office: 3 Contract duration: 8 months Location: London End client: Bank --------------------------------------- JOB DETAILS Role Title: Technology Architect Technology Architect – Databricks with over 12 years of experience in designing and leading large scale data engineering, analytics, and cloud transformation initiatives. The ideal candidate will have deep expertise in Databricks, big data architectures, cloud platforms (Azure), and modern data engineering frameworks. This role will be responsible for defining end to end architectural solutions, driving best practices, and guiding engineering teams to deliver scalable, secure, and cost optimized data platforms. \* Design end to end data platforms leveraging Databricks Lakehouse architecture, Delta Lake, Unity Catalog, and ML/AI workloads. \* Define data ingestion, transformation, governance, and consumption frameworks aligned to enterprise standards. \* Evaluate and recommend architectural improvements, new tools, and emerging technologies. \* Develop reference architectures, solution blueprints, and best-practice playbooks for Databricks implementations. \* Architect scalable ETL/ELT pipelines using PySpark, Spark SQL, Delta Live Tables, and Databricks Workflows. \* Implement performance optimization strategies for notebooks, clusters, job orchestration, and data storage. \* Guide teams in building curated, governed data models leveraging Delta Lake Medallion Architecture (Bronze–Silver–Gold).