Senior Data Engineer - Real-Time Market Data Platform

Keyrock; United States; Hybrid; USD 150,000 - 230,000; Full time

Benefits offered by this job

Flexible hours

Remote-first

Regular online get-togethers

Yearly onsite meetup

Job summary

Keyrock is seeking a Senior Data Engineer to build streaming and batch data pipelines, establish data contracts, and design a scalable lakehouse. You will own data quality, governance, and observability, while collaborating with Architecture, Infrastructure, and platform teams to ship reliable data products.

With 8+ years in production data systems, you’ll leverage Python/SQL expertise, implement cost-aware solutions, and contribute to a fast-moving crypto and DeFi data platform.

Qualifications

• 8+ years of building production data systems that other people rely on.
• Strong proficiency in Python and SQL: not just being able to write a query, but being able to reason about what the engine is doing with it.
• Code that’s easy for someone else to read, test, and delete later.
• Strong understanding of data modelling for both streaming and analytical workloads.
• Efficiency, quality, idempotency, and observability are taken seriously by default.

Responsibilities

• Build streaming and batch pipelines that ingest, normalise, and distribute market, trading, and portfolio data, resilient to feed and exchange failures.
• Build the self-serve tooling (SDKs, patterns, templates, AI agents) so other teams publish, consume, and build on data products without waiting on us.
• Own data contracts and schema evolution. Keep schema changes from turning into multi-team coordination events.
• Design the lakehouse and time-series layer around consumer query patterns.
• Build and evolve the Data Governance and Data Quality Framework: stale-feed detection, schema validation, range checks, idempotent writes, lineage, ownership, self-healing.
• Build the derived analytics the business runs on: cross-exchange spreads, VWAP at depth, order book microstructure for the desks; portfolio views, exposure, performance for wealth and asset management.
• Make observability, cost, and performance first-class from day one.
• Treat infrastructure as code (Docker, Terraform, CI/CD) alongside our Central Infrastructure Team.
• Work in the open: write things down, partner closely with Architecture, Infrastructure, Platform, and the rest of the teams.

Skills

Python

SQL

Data modeling

Streaming systems

Observability

Data governance

First principles thinking

Tools

Kafka/Redpanda/MSK/Kinesis

Docker

Terraform

CI/CD

Job description

Keyrock is seeking a Senior Data Engineer to build streaming and batch data pipelines, establish data contracts, and design a scalable lakehouse. You will own data quality, governance, and observability, while collaborating with Architecture, Infrastructure, and platform teams to ship reliable data products.

With 8+ years in production data systems, you’ll leverage Python/SQL expertise, implement cost-aware solutions, and contribute to a fast-moving crypto and DeFi data platform.