Azure Databricks Solution Architect

Test Triangle Limited

United Kingdom

On-site

GBP 90,000 - 125,000

Full time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Test Triangle Limited is seeking an experienced Azure Databricks Solution Architect to design and deliver scalable cloud-native data platforms on Azure. You will lead data engineering initiatives, architect end-to-end pipelines with Databricks, PySpark, Delta Lake, Synapse, and mentor teams in Agile delivery and CI/CD practices.

This role demands strong leadership, problem-solving, and collaboration with cross-functional stakeholders to enable enterprise analytics on Azure Data Factory and

Qualifications

  • Extensive data engineering experience with Databricks and PySpark.
  • Proven ability to design scalable data pipelines and architectures.
  • Experience in cloud environments, preferably Azure, with CI/CD practices.
  • Strong leadership and stakeholder management skills.

Responsibilities

  • Design and develop scalable data pipelines for ETL across sources.
  • Build and optimize large-scale data workflows using PySpark.
  • Tune and optimize performance of data pipelines.
  • Collaborate with cross-functional teams for data integration and analytics.
  • Support data lake architectures with Delta Lake and cloud platforms.
  • Apply Agile delivery practices and drive technical leadership.

Skills

PySpark
Data engineering
Solution architecture
Technical leadership
Agile delivery
Problem solving
Cross-functional collaboration

Tools

Databricks
Delta Lake
Azure Data Factory
Azure Synapse Analytics

Job description

Seeking an experienced Azure Databricks Solution Architect to design, develop, architect, and deliver scalable cloud-native data platforms on Azure. The role requires strong expertise in Azure Databricks, PySpark, Delta Lake, Azure Data Factory, Azure Synapse Analytics, and enterprise data engineering, coupled with solution architecture and technical leadership capabilities.

Key Responsibilities
  • Design and develop scalable data pipelines using Databricks for ETL processing across diverse data sources
  • Build and optimize large-scale data workflows using PySpark and Python
  • Ensure performance tuning, debugging, and optimization of data pipelines
  • Collaborate with cross-functional teams to enable data integration and analytics solutions
  • Support implementation of data lake architectures leveraging Delta Lake and cloud platforms
  • Knowledge of CI/CD practices and Agile delivery models
  • Strong analytical and problem-solving capabilities
Experience Requirements
  • Relevant experience in data engineering with strong exposure to Databricks and PySpark
  • Proven ability to handle large-scale structured and unstructured data pipelines
  • Experience working in cloud environments, preferably Azure
  • Exposure to performance optimization and scalable data processing architectures
  • Stakeholder Management
  • Technical Leadership
  • Agile Delivery
  • Problem Solving & Innovation
Certification (Good to Have)
  • Databricks Developer / Data Engineering certifications
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Azure Databricks Solution Architect
Azure Databricks Solution Architect

Test Triangle Limited • Milton Keynes

On-site
GBP 100,000 - 140,000
Azure Databricks Solution Architect Data Platform Leader
Azure Databricks Solution Architect Data Platform Leader

Test Triangle Limited • United Kingdom

On-site
GBP 90,000 - 125,000
Senior Databricks Solution Architect
Senior Databricks Solution Architect

Unison Group • Norwich

On-site
GBP 120,000 - 160,000
Data Engineer
Data Engineer

RedRock Resourcing • Birmingham

On-site
GBP 40,000 - 60,000
Application Developers | Data engineers
Application Developers | Data engineers

Luxoft • United Kingdom

Remote
GBP 70,000 - 120,000
Databricks Solution Architect
Databricks Solution Architect

GIS Recruiter Ltd • City Of London

On-site
GBP 120,000 - 165,000
Data Solution Architect
Data Solution Architect

Vallum Associates • Coventry

Hybrid
GBP 70,000 - 100,000
Senior Data Engineer - Databricks
Senior Data Engineer - Databricks

ISx4 Group • Belfast City District

Hybrid
GBP 70,000 - 100,000
Databricks Solution Architect
Databricks Solution Architect

GIS Recruiter Ltd • Greater London

On-site
GBP 90,000 - 130,000
Azure Databricks Architect: Scalable Data Platforms
Azure Databricks Architect: Scalable Data Platforms

Test Triangle Limited • Milton Keynes

On-site
GBP 100,000 - 140,000