Lead Data Engineer - Real-Time Streaming (Kafka/Flink)

Barclays; Glasgow; On-site; GBP 90,000 - 120,000; Full time

Job summary

Barclays in Glasgow is seeking a Lead Data Engineer to design and develop real-time data streaming solutions. You will blend technical leadership with hands-on coding and help shape engineering standards for scalable, low-latency systems.

The role focuses on streaming with Kafka and Flink, building data pipelines, data warehouses, and data lakes to support critical business processes in a dynamic financial technology environment.

Qualifications

• Experience with real-time streaming applications using Kafka Streams (KStream/KTable).
• Experience with Apache Flink including stateful processing and fault tolerance.
• Designing high-throughput, low-latency data pipelines.

Responsibilities

• Build and maintain data architectures and pipelines for durable, complete data processing.
• Design data warehouses and data lakes with appropriate security and scalability.
• Develop processing and analysis algorithms for complex data volumes.
• Collaborate with data scientists to build and deploy machine learning models.

Skills

Real-time streaming

Kafka Streams (KStream/KTable)

Apache Flink

Low-latency pipelines

Data architectures

Tools

Kafka Connect

AVRO

Confluent Schema Registry

Flink SQL

Table API

Prowide Core

ISO 20022 / MT

Job description

Barclays in Glasgow is seeking a Lead Data Engineer to design and develop real-time data streaming solutions. You will blend technical leadership with hands-on coding and help shape engineering standards for scalable, low-latency systems.

The role focuses on streaming with Kafka and Flink, building data pipelines, data warehouses, and data lakes to support critical business processes in a dynamic financial technology environment.