Lead Data Platform Engineer – High-Volume Trading

The London Metal Exchange Limited; Greater London; Hybrid; GBP 120,000 - 180,000; Full time

Job summary

The London Metal Exchange Limited is seeking a Principal Data Engineer in London to help shape a scalable, high-velocity data platform for trading data. The role focuses on delivering a robust data foundation, enabling self-service capabilities, and supporting analytics across the business.

You will drive the implementation of data lakes, warehouses, and real-time streams using Kafka, Flink, Spark, Iceberg and cloud-native practices with Kubernetes/OpenShift.

Qualifications

• 10+ years in software development with JVM languages.
• Experience building scalable data platforms and data lakes.
• Knowledge of data warehouses and distributed systems.
• Ability to design self-service data capabilities and APIs.

Responsibilities

• Help shape a scalable data platform for trading data.
• Deliver resilient data pipelines and data products for engineering teams.
• Enable on-boarding, processing, discovery, and consumption of data.
• Lead data ingestion, storage, streaming, and analytics workstreams.
• Implement cloud-native practices with Kubernetes/OpenShift, Terraform, and CI/CD.

Skills

JVM languages

Data platform design

Distributed systems

Self-service data

Data governance

Tools

Kafka

Flink

Spark

Iceberg

S3

Kubernetes

OpenShift

Terraform

DataHub/OpenMetadata

Job description

The London Metal Exchange Limited is seeking a Principal Data Engineer in London to help shape a scalable, high-velocity data platform for trading data. The role focuses on delivering a robust data foundation, enabling self-service capabilities, and supporting analytics across the business.

You will drive the implementation of data lakes, warehouses, and real-time streams using Kafka, Flink, Spark, Iceberg and cloud-native practices with Kubernetes/OpenShift.