Real-Time Data Platform Lead

3761 Barclays - BX - UK; Glasgow; On-site; GBP 90,000 - 120,000; Full time

Job summary

Barclays invites applications for a Lead Data Engineer based in Glasgow. You will design and develop real-time data streaming solutions using Kafka Streams and Apache Flink, building scalable, low-latency data platforms to support critical business processes.

You will influence architecture, standards, and collaboration with data scientists for model deployment. The role emphasizes technical direction, development work, and partnerships with stakeholders to deliver robust data infrastructure in

Qualifications

• Experience with real-time streaming applications using Kafka Streams and KStream/KTable concepts.
• Experience with Apache Flink solutions, including stateful processing, checkpointing, and fault tolerance.
• Proficiency in high-throughput, low-latency data pipelines for large data volumes.
• Knowledge of financial messaging standards (ISO 20022, MT) and parsing with Prowide Core; familiarity with Kafka Connect, AVRO, and Schema Registry.
• Experience applying Flink SQL/Table API for stream processing use cases.

Responsibilities

• Lead the design and development of real-time data streaming solutions.
• Shape engineering standards and practices for reliable, scalable systems.
• Collaborate with data scientists to deploy machine learning models.

Skills

Real-time streaming

Kafka Streams

Flink

High-throughput pipelines

Financial messaging standards

Prowide Core

Kafka Connect

AVRO & Schema Registry

Flink SQL/Table API

Tools

Kafka Streams

Apache Flink

Prowide Core

AVRO

Confluent Schema Registry

Job description

Barclays invites applications for a Lead Data Engineer based in Glasgow. You will design and develop real-time data streaming solutions using Kafka Streams and Apache Flink, building scalable, low-latency data platforms to support critical business processes.

You will influence architecture, standards, and collaboration with data scientists for model deployment. The role emphasizes technical direction, development work, and partnerships with stakeholders to deliver robust data infrastructure in