Senior Data Platform Engineer – Real-Time Streaming

Keyrock

City of Johannesburg Metropolitan Municipality

Remote

ZAR 1,200,000 - 1,800,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Keyrock is building a modern Data Platform with streaming and batch pipelines, governance, and a lakehouse. You will help ingest, normalise, and distribute market and portfolio data across trading desks and asset management teams.

You will design scalable data models for streaming and analytical workloads, ensure data quality, and ship self-serve tooling for other teams to publish or consume data quickly.

Qualifications

  • 8+ years building production data systems
  • Strong proficiency in Python and SQL
  • Readable, testable, maintainable code
  • Data modelling for streaming and analytical workloads
  • Emphasis on efficiency, quality, idempotency, observability

Responsibilities

  • Build streaming and batch pipelines for market, trading, and portfolio data
  • Create self-serve tooling (SDKs, templates) for data products
  • Own data contracts and schema evolution
  • Design lakehouse and time-series storage around query patterns
  • Develop Data Governance and Data Quality Frameworks
  • Develop derived analytics like VWAP, exposure, performance metrics
  • Prioritise observability, cost, and performance from day one
  • Collaborate with Architecture, Infra, Platform teams and open work
  • Treat infrastructure as code (Docker, Terraform, CI/CD)

Skills

Python
SQL
Data modeling
Streaming systems
Observability
Code readability
Self-healing

Tools

Kafka/Redpanda/Kinesis
ClickHouse
TimescaleDB/QuestDB
Docker
Terraform
CI/CD

Job description

Keyrock is building a modern Data Platform with streaming and batch pipelines, governance, and a lakehouse. You will help ingest, normalise, and distribute market and portfolio data across trading desks and asset management teams.

You will design scalable data models for streaming and analytical workloads, ensure data quality, and ship self-serve tooling for other teams to publish or consume data quickly.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer / Platform Lead
Senior Data Engineer / Platform Lead

Ats Client • Pretoria

On-site
ZAR 900,000 - 1,300,000
Data Platform Engineer - Pipelines, Lakehouse & Quality
Data Platform Engineer - Pipelines, Lakehouse & Quality

BETSoftware • Johannesburg

On-site
ZAR 540,000 - 900,000
Senior Data Engineer - Cloud Lakehouse & Real-Time Data
Senior Data Engineer - Cloud Lakehouse & Real-Time Data

DigiOutsource • Cape Town

On-site
ZAR 600,000 - 800,000
Comprehensive learning and development programmes
Free daily meals
Free on-site gym access
+2
Senior Data Engineer: Platform-Scale Data & Backend Solutions
Senior Data Engineer: Platform-Scale Data & Backend Solutions

Network Finance • Randburg

On-site
ZAR 900,000 - 1,500,000
Senior Data Platform Architect – Real-Time & Governance
Senior Data Platform Architect – Real-Time & Governance

Takealot Group • Cape Town

Hybrid
ZAR 1,200,000 - 1,800,000
Hybrid working model
Staff discount
Birthday leave
+3
Real-Time Data Engineer: ML Pipelines & APIs
Real-Time Data Engineer: ML Pipelines & APIs

Boardroom Appointments • Gqeberha

On-site
ZAR 550,000 - 900,000
Senior Data Engineer — Cloud Lakehouse & Streaming
Senior Data Engineer — Cloud Lakehouse & Streaming

Digital Outsource Services (Pty) • Cape Town

On-site
ZAR 900,000 - 1,500,000
Senior Data Engineer – Cloud Data & Real-Time Analytics
Senior Data Engineer – Cloud Data & Real-Time Analytics

SuperGroup International • Cape Town

On-site
ZAR 900,000 - 1,300,000
Free Daily Meal
Free On-Site Gym
Group Life Cover
+6
Senior Data Platform Engineer – Lakehouse & Cloud
Senior Data Platform Engineer – Lakehouse & Cloud

Blue Pearl PTY • Johannesburg

On-site
ZAR 800,000 - 1,200,000
None
Senior Data Engineer
Senior Data Engineer

Carbon Data Solutions • South Africa

Remote
ZAR 900,000 - 1,800,000