Data Engineer (Energy Trading)

X4 Technology; Greater London; On-site; GBP 65,000 - 90,000; Part time

Job summary

X4 Technology in London is leading a strategic data transformation for a major energy trading business, delivering a Databricks-powered data platform and modern visualisation that replace Excel-based analysis.

You will own data products end-to-end, designing pipelines, building APIs with FastAPI, and ensuring production readiness with CI/CD, Docker and Kubernetes, while collaborating with stakeholders across the trading desks.

Qualifications

• Strong hands-on Python, PySpark, Databricks and SQL Server experience.
• Strong FastAPI experience is essential.
• Azure cloud experience, plus Docker and Kubernetes.
• Data architecture and governance understanding.
• Excellent stakeholder engagement with technical and non-technical audiences.

Responsibilities

• Design, build and maintain scalable data pipelines and data products using Python, PySpark, Databricks and SQL Server.
• Develop and support modern REST APIs and backend services using FastAPI.
• Own end-to-end engineering across the full SDLC with collaboration across stakeholders.
• Build and maintain CI/CD pipelines with GitHub Actions and containerised deployments using Docker and Kubernetes.
• Champion engineering best practices, testing, security, observability and operational excellence.

Skills

Python

PySpark

Databricks

SQL Server

FastAPI

Azure

Docker

Kubernetes

GitHub Actions

Stakeholder engagement

Tools

Docker

Kubernetes

GitHub Actions

Job description

Contract: Initial 6-month contract (long-term transformation programme)

X4 Technology are partnered with a major energy trading organisation on a strategic programme to unlock the power of their data across Trading, driving sharper decision-making and new cross-commodity trading opportunities.

Key focuses are pulling analysis out of Excel, unlocking modern visualisation tools and building out a proper Databricks-powered data platform to give trading desks real, near-term value from their data.

Joining as Data Engineer, you'll own data products end-to-end - from design and build through to deployment and live support - combining serious data engineering experience with strong backend/API development.

Responsibilities for the Data Engineer

• Design, build and maintain scalable data pipelines and data products using Python, PySpark, Databricks and SQL Server
• Develop and support modern REST APIs and backend services using FastAPI - a genuine hands-on API-building role, not just pipelines
• Own engineering end-to-end across the full SDLC - design, build, test, deploy, monitor and support - working closely with stakeholders, product owners, architects and engineers to turn requirements into robust solutions
• Build and maintain CI/CD pipelines, automated testing and release automation via GitHub Actions, plus containerised deployments using Docker and Kubernetes
• Champion engineering best practice - code reviews, automated testing, security, observability and operational excellence

Requirements for the Data Engineer

• Strong hands-on Python, PySpark, Databricks and SQL Server experience
• Strong, proven FastAPI experience - this is essential, not a nice-to-have
• Solid Azure cloud experience, plus Docker, Kubernetes and GitOps
• Strong understanding of data architecture, data modelling and data governance principles
• Excellent stakeholder engagement - comfortable with both technical and non-technical audiences

A brilliant opportunity to build modern, cloud-native data products at the heart of a major trading business's data transformation - full ownership from design to production, with real influence over how the platform evolves.