Real-Time Data Engineer: Streaming & Feature Store

Markin; Greater London; On-site; GBP 80,000 - 110,000; Full time

Job summary

Markin in London is seeking a seasoned Data Engineer to own the real-time ingestion layer, compute features, and uphold contracts that keep the platform honest. You will design and operate streaming pipelines at enterprise volume using Kafka, Flink, or equivalent.

You will own the online feature store in Markin, ensure freshness and cost efficiency, codify schemas, and debug complex distributed issues. Strong software engineering fundamentals and 5+ years in real-time data engineering are

Qualifications

• 5+ years in data engineering, with real-time systems experience.
• Fluent with Kafka, Flink or Spark Streaming and modern lakehouse tooling.
• Strong software engineering fundamentals; write reliable, maintainable code.

Responsibilities

• Design and operate streaming pipelines (Kafka, Flink or equivalent) at enterprise volume.
• Own the online feature store: freshness, correctness, cost.
• Codify schemas and contracts across producers and consumers.
• Debug the hard, distributed, midnight kind of problems.

Skills

Real-time systems

Streaming pipelines

Software engineering

Tools

Kafka

Flink

Spark Streaming

Lakehouse tooling

Job description

Markin in London is seeking a seasoned Data Engineer to own the real-time ingestion layer, compute features, and uphold contracts that keep the platform honest. You will design and operate streaming pipelines at enterprise volume using Kafka, Flink, or equivalent.

You will own the online feature store in Markin, ensure freshness and cost efficiency, codify schemas, and debug complex distributed issues. Strong software engineering fundamentals and 5+ years in real-time data engineering are