Senior Data Engineer — Hybrid Role: Real-Time Data Platform

Lloyds Banking Group; Greater London; Hybrid; GBP 84,000 - 95,000; Full time

Benefits offered by this job

Pension

Annual bonus

Share schemes

Discounts

30 days holiday

Wellbeing

Job summary

Lloyds Banking Group is seeking a Senior Data Engineer to join the Data Platform team in London. You will design, build and operate scalable data infrastructure powering real-time and batch analytics across sources, ensuring reliability and performance.

In this hybrid role, you’ll collaborate with engineers, data scientists and stakeholders to advance the bank’s data platform, promote best-practice data engineering and deliver secure, scalable pipelines and data services.

Qualifications

• At least 5 years' experience as a Data Engineer in real-time and batch environments.
• Strong experience with streaming technologies (Kafka, Pub/Sub, or Kinesis).
• Solid understanding of data warehousing principles including relational modelling, query optimisation and administration.
• Strong programming experience with Python, Go and/or SQL.
• Experience using dbt for data modelling and transformation.
• Experience working with Apache Airflow or similar orchestration tooling.
• Proven experience designing and building production systems on GCP and/or AWS.
• Strong understanding of event-driven architectures and distributed systems.
• Experience deploying and supporting batch and real-time machine learning workloads.
• Experience working with distributed processing technologies such as Spark or Apache Beam.
• Strong understanding of data quality principles and engineering best practices.
• Experience optimising database performance, troubleshooting issues and maintaining production data systems.

Responsibilities

• Design, build and operate scalable data infrastructure across real-time and batch platforms.
• Ensure reliability, performance and availability of data warehouse and pipelines.
• Collaborate with engineers, data scientists, ML researchers and business stakeholders to shape the data platform.

Skills

Kafka

Pub/Sub

Kinesis

Python

Go

SQL

dbt

Airflow

GCP

AWS

Spark

Beam

Data Warehousing

Event-driven

Distributed systems

Tools

Python

Go

SQL

dbt

Airflow

GCP

AWS

Job description

Lloyds Banking Group is seeking a Senior Data Engineer to join the Data Platform team in London. You will design, build and operate scalable data infrastructure powering real-time and batch analytics across sources, ensuring reliability and performance.

In this hybrid role, you’ll collaborate with engineers, data scientists and stakeholders to advance the bank’s data platform, promote best-practice data engineering and deliver secure, scalable pipelines and data services.