Principal Databricks Data Platform Engineer - Hybrid London

X4 Technology

Greater London

Hybrid

GBP 157,000 - 175,000

Full time

4 days ago
Be an early applicant
Application generator

Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

X4 Technology is delivering a major transformation of its Data Exchange platform for a global energy trading firm in London. The role combines hands-on Azure Databricks engineering with ownership of data architecture, streaming and platform engineering across multiple workstreams.

The Principal Data Engineer will shape the end-to-end data platform, drive standards, and collaborate with architects, engineers and business stakeholders to enable secure, scalable data solutions and explore

Qualifications

  • Extensive hands-on Azure Databricks experience with enterprise-scale platforms.
  • Proven ownership of data platform architecture including data modelling and governance.
  • Experience leading large-scale data transformation programmes across multiple workstreams.
  • Strong real-time data and integration experience, including streaming architectures.
  • Excellent technical stakeholder management and influencing.

Responsibilities

  • Own end-to-end data and platform architecture across multiple workstreams.
  • Lead design/delivery of the Databricks data platform - batch and real-time ingestion, streaming, modelling, integration across Azure.
  • Set technical direction and engineering standards for performance, security and cost optimisation.
  • Be the go-to person across Architects, Engineers, Programme Managers and Trading stakeholders.
  • Identify opportunities for AI and automation (MLflow, Azure AI Foundry, Copilot).

Skills

Azure Databricks
PySpark
Python
SQL
Delta Lake
Structured Streaming
Data modelling
Governance
Security

Tools

Kafka
Delta Live Tables

Job description

X4 Technology is delivering a major transformation of its Data Exchange platform for a global energy trading firm in London. The role combines hands-on Azure Databricks engineering with ownership of data architecture, streaming and platform engineering across multiple workstreams.

The Principal Data Engineer will shape the end-to-end data platform, drive standards, and collaborate with architects, engineers and business stakeholders to enable secure, scalable data solutions and explore

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Principal Data Engineer (Databricks)
Principal Data Engineer (Databricks)

X4 Technology • Greater London

Hybrid
GBP 157,000 - 175,000
Data Engineer for Azure Databricks Platform Transformation
Data Engineer for Azure Databricks Platform Transformation

X4 Technology • Greater London

On-site
GBP 65,000 - 90,000
Data Engineer (Energy Trading) – Databricks/API Platform
Data Engineer (Energy Trading) – Databricks/API Platform

X4 Technology • Greater London

On-site
GBP 65,000 - 90,000
Senior Azure Data Engineer (Databricks) – Hybrid London
Senior Azure Data Engineer (Databricks) – Hybrid London

Capco • Greater London

Hybrid
GBP 80,000 - 110,000
Discretionary bonus
Health insurance
Continuous learning opportunities
+3
Data Engineer (Databricks)
Data Engineer (Databricks)

X4 Technology • Greater London

On-site
GBP 65,000 - 90,000
Azure & Databricks Principal Data Engineer (Energy Trading)
Azure & Databricks Principal Data Engineer (Energy Trading)

Eaglecliff Recruitment • England

On-site
GBP 120,000 - 150,000
Databricks Platform Engineer — Hybrid London (FinOps & Security)
Databricks Platform Engineer — Hybrid London (FinOps & Security)

Stichting Codam • Greater London

Hybrid
GBP 70,000 - 110,000
Senior Data Engineer - Databricks (Hybrid, London)
Senior Data Engineer - Databricks (Hybrid, London)

Tenth Revolution Group • Greater London

Hybrid
GBP 51,000 - 85,000
Databricks Platform Owner | Hybrid London | Up to £75K
Databricks Platform Owner | Hybrid London | Up to £75K

Ethiq • Greater London

Hybrid
GBP 68,000 - 83,000
London-Based Platform Architect: Databricks & FinOps Lead
London-Based Platform Architect: Databricks & FinOps Lead

Experis • Greater London

On-site
GBP 52,000 - 56,000