Senior Data Engineer

Lloyds Banking Group; Greater London; Hybrid; GBP 84,000 - 95,000; Full time

Benefits offered by this job

Pension

Annual bonus

Share schemes

Discounts

30 days holiday

Wellbeing

Job summary

Lloyds Banking Group is seeking a Senior Data Engineer to join the Data Platform team in London. You will design, build and operate scalable data infrastructure powering real-time and batch analytics across sources, ensuring reliability and performance.

In this hybrid role, you’ll collaborate with engineers, data scientists and stakeholders to advance the bank’s data platform, promote best-practice data engineering and deliver secure, scalable pipelines and data services.

Qualifications

• At least 5 years' experience as a Data Engineer in real-time and batch environments.
• Strong experience with streaming technologies (Kafka, Pub/Sub, or Kinesis).
• Solid understanding of data warehousing principles including relational modelling, query optimisation and administration.
• Strong programming experience with Python, Go and/or SQL.
• Experience using dbt for data modelling and transformation.
• Experience working with Apache Airflow or similar orchestration tooling.
• Proven experience designing and building production systems on GCP and/or AWS.
• Strong understanding of event-driven architectures and distributed systems.
• Experience deploying and supporting batch and real-time machine learning workloads.
• Experience working with distributed processing technologies such as Spark or Apache Beam.
• Strong understanding of data quality principles and engineering best practices.
• Experience optimising database performance, troubleshooting issues and maintaining production data systems.

Responsibilities

• Design, build and operate scalable data infrastructure across real-time and batch platforms.
• Ensure reliability, performance and availability of data warehouse and pipelines.
• Collaborate with engineers, data scientists, ML researchers and business stakeholders to shape the data platform.

Skills

Kafka

Pub/Sub

Kinesis

Python

Go

SQL

dbt

Airflow

GCP

AWS

Spark

Beam

Data Warehousing

Event-driven

Distributed systems

Tools

Python

Go

SQL

dbt

Airflow

GCP

AWS

Job description

JOB TITLE: Senior Data Engineer

SALARY: £84,051 - £95,000

LOCATION: London

HOURS: Full-Time

WORKING PATTERN: Our work style is hybrid, which involves spending at least two days per week, or 40% of our time, at one of our office sites. Colleagues with disabilities can be supported with workplace adjustments including hybrid working expectations in line with our Flexibility Works policy.

What you'll be doing

We're looking for a Senior Data Engineer to join our Data Platform team and help build the foundations that power Curve's data-driven culture. Working across both real-time and batch data platforms, you'll design, build and operate scalable data infrastructure that collects, processes and serves data from a wide range of internal and external sources. You'll play a key role in ensuring the reliability, performance and availability of our data warehouse and data pipelines, enabling cutting-edge analytics, machine learning, real-time decisioning and operational reporting. Collaborating closely with engineers, data scientists, machine learning researchers and business stakeholders, you'll help shape the future of our data platform while promoting best practice in data engineering, architecture and quality.

Why Join us?

If you think all banks are the same, you're wrong. We're a pioneering, fast-changing business that's shaping finance as a force for good. If you're after a role where you can have an impact and do the best work of your career, you've just found it

What we're looking for?

• At least 5 years' experience as a Data Engineer working with real-time and batch data in production environments
• Strong experience with streaming technologies such as Kafka, Pub/Sub or Kinesis
• Solid understanding of data warehousing principles including relational modelling, query optimisation and administration
• Strong programming experience with Python, Go and/or SQL
• Experience using dbt for data modelling and transformation
• Experience working with Apache Airflow or similar orchestration tooling
• Proven experience designing and building production systems on GCP and/or AWS
• Strong understanding of event-driven architectures and distributed systems
• Experience deploying and supporting batch and real-time machine learning workloads
• Experience working with distributed processing technologies such as Spark or Apache Beam
• Strong understanding of data quality principles and engineering best practices
• Experience optimising database performance, troubleshooting issues and maintaining production data systems
• Ability to learn new technologies quickly and apply them pragmatically in a fast-moving environment

And it would be great if you had any of the following...

• Experience developing or supporting machine learning solutions
• Experience with Terraform and Infrastructure as Code
• Experience with Kubernetes and containerised environments
• Experience working with LLMs and agentic workflows
• Experience mentoring or supporting other engineers
• Strong understanding of large-scale distributed architecture patterns
• Knowledge of security and information security considerations within data engineering
• Experience within Fintech, Financial Services, Payments or Retail Banking

This is a place for you

Our ambition is to be the leading UK business for diversity, equity and inclusion, supporting our customers, colleagues and communities. We are committed to creating an environment in which everyone can thrive, learn and develop. We were one of the first major organisations to set goals on diversity in senior roles, create a menopause health package, and launch a dedicated Working with Cancer initiative.

We offer reasonable workplace adjustments for colleagues with disabilities, including flexibility in office attendance, location and working patterns. As a Disability Confident Leader, we guarantee interviews for a fair and proportionate number of applicants who meet the minimum criteria for the role and have a disability, long-term health or neurodivergent condition, through the Disability Confident Scheme.

We provide reasonable adjustments throughout the recruitment process to reduce or remove barriers - just let us know what you need.

We also offer a wide-ranging benefits package, which includes

• A generous pension contribution of up to 15%
• An annual bonus award, subject to Group performance
• Share schemes including free shares
• Benefits you can adapt to your lifestyle, such as discounted shopping
• 30 days' holiday, with bank holidays on top
• A range of wellbeing initiatives and generous parental leave policies