Senior Data Platform Architect – Real-Time Trading Data

HKEX Group; Greater London; Hybrid; GBP 120,000 - 200,000; Full time

Job summary

HKEX Group in London seeks a Principal Data Engineer to shape a strategic, scalable data platform for high-volume trading data. The role focuses on building a resilient data foundation, enabling rapid, self-serve data access for engineering teams and analytics workloads.

You will influence technology strategy, drive platform reliability and performance, and work across Trading Technology, Data Engineering and Platform Engineering to deliver a data-driven trading infrastructure.

Qualifications

• Ten+ years of hands-on software development experience in IT organisations.
• Expertise in scalable data platforms, data warehouses (SQL Server, Postgres) and data lakes.
• Proven ability to solve performance, scalability and latency challenges in large distributed systems.
• Self-service data platform capabilities enabling onboarding, processing, discovery and consumption of data.
• Influences tech strategy and roadmaps across Trading Tech, Data Eng and Platform Eng.
• Builds high-volume platforms handling billions of events daily and terabytes of data.
• Experience with Data Lakehouse using S3 storage, Iceberg, Spark and Trino.
• Real-time streaming with Kafka and Flink for low-latency processing.
• Strong in CI/CD, GitOps, Kubernetes/OpenShift, Terraform and IAM/security best practices.
• Knowledge of data lineage, metadata and governance tools (DataHub/OpenMetadata/Atlas).
• Understanding of financial markets; Bamboo CI/CD knowledge is a bonus; Kafka certification is a plus.

Responsibilities

• Shape a scalable data platform to reliably process, store and serve high-volume trading data.
• Provide self-service capabilities for engineering teams to onboard and use data effectively.
• Lead platform engineering efforts to improve reliability, performance and security.
• Design APIs and data products with metadata services for developer enablement.
• Drive platform-wide CI/CD and infrastructure as code practices and governance.
• Collaborate across Trading Tech, Data Eng and Platform Eng to set roadmaps.

Skills

Java/Scala/Kotlin

Distributed data platforms

Data lakes

PostgreSQL/SQL Server

Kafka/Stream processing

Spark/Trino

Iceberg/Data Lakehouse

Kubernetes/OpenShift

Terraform/CI-CD

Data governance/Metadata

Tools

DataHub

OpenMetadata

Apache Atlas

Apache Kafka

Apache Flink

Spark

Trino

Iceberg

Job description

HKEX Group in London seeks a Principal Data Engineer to shape a strategic, scalable data platform for high-volume trading data. The role focuses on building a resilient data foundation, enabling rapid, self-serve data access for engineering teams and analytics workloads.

You will influence technology strategy, drive platform reliability and performance, and work across Trading Technology, Data Engineering and Platform Engineering to deliver a data-driven trading infrastructure.