Remote Senior Data Engineer — Streaming & Lakehouse

Keyrock; Bahrain; On-site; BHD 55,800 - 78,120; Full time

Job summary

Keyrock is building a modern Data Platform to empower traders, asset managers, and researchers with real-time and batch data access. You’ll join the Central Data Team as an early hire to shape architecture, governance, and tooling that enables fast, autonomous data work across multiple business functions.

You will design streaming and analytical data systems, own schema evolution, and contribute to self-serve data infrastructure.

Qualifications

• 8+ years of building production data systems that other people rely on.
• Strong proficiency in Python and SQL: not just writing a query, but understanding how the engine executes it.
• Readable, testable, and maintainable code that others can modify later.
• Strong understanding of data modelling for streaming and analytical workloads.
• Emphasis on efficiency, quality, idempotency, and observability by default.

Responsibilities

• Build streaming and batch pipelines that ingest, normalise, and distribute market, trading, and portfolio data, resilient to feed and exchange failures.
• Build the self-serve tooling (SDKs, patterns, templates, AI agents) so other teams publish, consume, and build on data products without waiting on us.
• Own data contracts and schema evolution, preventing multi-team coordination frictions.
• Design the lakehouse and time-series layer around consumer query patterns.
• Build and evolve the Data Governance and Data Quality Framework: stale-feed detection, schema validation, range checks, idempotent writes, lineage, ownership, self-healing.
• Build the derived analytics the business runs on: cross-exchange spreads, VWAP at depth, order book microstructure for desks; portfolio views, exposure, performance for wealth and asset management.
• Make observability, cost, and performance first-class from day one.
• Treat infrastructure as code (Docker, Terraform, CI/CD) alongside our Central Infrastructure Team.
• Work in the open: write things down, partner closely with Architecture, Infrastructure, Platform, and the rest of the teams.

Skills

Python

SQL

Data modelling

Observability

Idempotent design

Tools

Docker

Terraform

CI/CD

Job description

Keyrock is building a modern Data Platform to empower traders, asset managers, and researchers with real-time and batch data access. You’ll join the Central Data Team as an early hire to shape architecture, governance, and tooling that enables fast, autonomous data work across multiple business functions.

You will design streaming and analytical data systems, own schema evolution, and contribute to self-serve data infrastructure.