Principal Data Engineer: Trading Data Platform Leader

The London Metal Exchange; Greater London; On-site; GBP 120,000 - 190,000; Full time

Job summary

The London Metal Exchange in London is seeking a Principal Data Engineer to shape the data platform, processing vast trading data with scalable, reliable systems.

You will lead initiatives across ingestion, storage, streaming, and data products, collaborating with Trading Tech, Data Engineering, and IT to deliver self-service capabilities and robust data services for analytics and trading workloads.

Qualifications

• 10+ years of software development experience, JVM languages preferred.
• Experience building scalable data platforms, data warehouses, and data lakes.
• Proven ability to solve latency, scalability and reliability challenges in large systems.
• Ability to deliver self-service data platform capabilities for engineering teams.

Responsibilities

• Shape and evolve the data platform strategy for high-volume trading data.
• Lead data engineering and platform engineering initiatives across teams.
• Ensure data security, governance, and regulatory compliance.

Skills

Java/Scala/Kotlin

Distributed systems

Kafka/Flink

Kubernetes/Cloud

Postgres/Snowflake

Spark

Data Lakes/Lakehouse

CI/CD (Bamboo)

Tools

Apache Kafka

Apache Iceberg

S3-compatible storage

Spark

OpenMetadata/DataHub

Terraform

Job description

The London Metal Exchange in London is seeking a Principal Data Engineer to shape the data platform, processing vast trading data with scalable, reliable systems.

You will lead initiatives across ingestion, storage, streaming, and data products, collaborating with Trading Tech, Data Engineering, and IT to deliver self-service capabilities and robust data services for analytics and trading workloads.