Senior Data Engineer - Remote Real-Time Platform

Keyrock; Greater London; On-site; GBP 90,000 - 140,000; Full time

Job summary

Keyrock is hiring for a Principal Data Engineer to join the Central Data Team (CDT). The role focuses on building a scalable data platform that ingests, normalises, and serves market, trading, and portfolio data in real time.

You will own data contracts, schema evolution, and the lakehouse design while driving data governance, observability, and cost-aware decisions across multiple teams.

Qualifications

• 8+ years building production data systems
• Proficient in Python and SQL with performance understanding
• Readable, maintainable code with future-proofing
• Strong data modelling for streaming and analytical workloads
• Emphasis on efficiency, quality, idempotency, and observability
• Experience with streaming systems and time-series stores
• Familiarity with lakehouse architectures and partitioning

Responsibilities

• Build streaming and batch pipelines ingesting market and portfolio data
• Create self-serve tooling (SDKs, templates) for data products
• Own data contracts and schema evolution to avoid multi-team coordination
• Design lakehouse and time-series layer around common query patterns
• Develop Data Governance and Data Quality framework
• Build analytics for cross-exchange spreads and portfolio views
• Prioritize observability, cost, and performance from day one
• Collaborate with Infrastructure to treat infrastructure as code

Skills

Data systems

Python

SQL

Streaming

Data modelling

Observability

CI/CD

Tools

Kafka/Redpanda/MSK/Kinesis

ClickHouse/TimescaleDB/QuestDB

Docker

Terraform

Job description

Keyrock is hiring for a Principal Data Engineer to join the Central Data Team (CDT). The role focuses on building a scalable data platform that ingests, normalises, and serves market, trading, and portfolio data in real time.

You will own data contracts, schema evolution, and the lakehouse design while driving data governance, observability, and cost-aware decisions across multiple teams.