Data Engineer (Energy Trading) – Databricks/API Platform

X4 Technology; Greater London; On-site; GBP 65,000 - 90,000; Part time

Job summary

X4 Technology in London is leading a strategic data transformation for a major energy trading business, delivering a Databricks-powered data platform and modern visualisation that replace Excel-based analysis.

You will own data products end-to-end, designing pipelines, building APIs with FastAPI, and ensuring production readiness with CI/CD, Docker and Kubernetes, while collaborating with stakeholders across the trading desks.

Qualifications

• Strong hands-on Python, PySpark, Databricks and SQL Server experience.
• Strong FastAPI experience is essential.
• Azure cloud experience, plus Docker and Kubernetes.
• Data architecture and governance understanding.
• Excellent stakeholder engagement with technical and non-technical audiences.

Responsibilities

• Design, build and maintain scalable data pipelines and data products using Python, PySpark, Databricks and SQL Server.
• Develop and support modern REST APIs and backend services using FastAPI.
• Own end-to-end engineering across the full SDLC with collaboration across stakeholders.
• Build and maintain CI/CD pipelines with GitHub Actions and containerised deployments using Docker and Kubernetes.
• Champion engineering best practices, testing, security, observability and operational excellence.

Skills

Python

PySpark

Databricks

SQL Server

FastAPI

Azure

Docker

Kubernetes

GitHub Actions

Stakeholder engagement

Tools

Docker

Kubernetes

GitHub Actions

Job description

X4 Technology in London is leading a strategic data transformation for a major energy trading business, delivering a Databricks-powered data platform and modern visualisation that replace Excel-based analysis.

You will own data products end-to-end, designing pipelines, building APIs with FastAPI, and ensuring production readiness with CI/CD, Docker and Kubernetes, while collaborating with stakeholders across the trading desks.