Azure Databricks Tech Lead - Data Platform (Contract)

X4 Technology; Greater London; On-site; GBP 90,000 - 140,000; Part time

Job summary

X4 Technology is seeking an experienced Contract Technical Lead to steer the Azure Databricks data platform within a major energy trading transformation. You will define technical direction, drive architecture decisions, optimise performance and enforce engineering standards across the programme.

Join a multi-year migration from Oracle to Azure Databricks, delivering real-time analytics, governance, and scalable data platforms for global Endur reporting.

Qualifications

• Proven experience leading the design and delivery of enterprise-scale Azure Data Platform and Databricks solutions.
• Strong hands-on expertise with Azure Databricks, Structured Streaming, Delta Live Tables, PySpark, Python and SQL, with a focus on performance optimisation.
• Strong understanding of cloud data architecture, data governance, data quality and engineering best practices.
• Excellent leadership, stakeholder management and communication skills, with experience mentoring teams and driving technical delivery.

Responsibilities

• Lead the architecture, design and delivery of scalable Azure Databricks data solutions, providing technical leadership from solution design through to production.
• Drive best practices across data engineering, platform architecture, governance, security and engineering standards, mentoring teams and influencing technical direction.
• Optimise Databricks performance, including Structured Streaming, Delta Live Tables and cloud cost efficiency.
• Partner with business stakeholders, architects and engineering teams to translate complex requirements into scalable, high-performance data solutions.
• Lead the migration of legacy enterprise data platforms into Azure Databricks, delivering a unified data platform for Endur, global reporting and analytics while shaping its long-term evolution.

Skills

Azure Databricks

Structured Streaming

Delta Live Tables

PySpark

Python

SQL

Cloud data architecture

Leadership

Stakeholder management

Job description

X4 Technology is seeking an experienced Contract Technical Lead to steer the Azure Databricks data platform within a major energy trading transformation. You will define technical direction, drive architecture decisions, optimise performance and enforce engineering standards across the programme.

Join a multi-year migration from Oracle to Azure Databricks, delivering real-time analytics, governance, and scalable data platforms for global Endur reporting.