Senior Data Engineer

Lloyds Banking Group; City of Westminster; On-site; GBP 90,000 - 130,000; Full time

Benefits offered by this job

A generous pension contribution up to

Annual bonus award

Share schemes

Discounted shopping

30 days holiday

Wellbeing initiatives

Parental leave policies

Job summary

Lloyds Banking Group is seeking a Senior Data Engineer to join the Data Platform team in the UK. You will design, build and operate scalable data infrastructure handling real-time and batch data, enabling analytics and ML workloads.

You will work closely with engineers, data scientists and business stakeholders to ensure reliability, performance and data quality across data warehouses and pipelines.

Qualifications

• 5+ years' experience as a Data Engineer in production environments
• Experience with streaming technologies such as Kafka, Pub/Sub or Kinesis
• Solid understanding of data warehousing principles including relational modelling, query optimisation and administration
• Strong programming experience with Python, Go and/or SQL
• Experience using dbt for data modelling and transformation
• Experience with Apache Airflow or similar orchestration tooling
• Proven experience designing and building production systems on GCP and/or AWS
• Strong understanding of event-driven architectures and distributed systems
• Experience deploying and supporting batch and real-time machine learning workloads
• Experience with distributed processing technologies such as Spark or Apache Beam
• Strong understanding of data quality principles and engineering best practices
• Experience optimising database performance and maintaining production data systems

Responsibilities

• Design, build and operate scalable data infrastructure for real-time and batch data
• Ensure reliability, performance and availability of data warehouse and pipelines
• Collaborate with engineers, data scientists and business stakeholders to promote best practices in data engineering

Skills

Python

Go

SQL

Tools

Kafka

Pub/Sub

Kinesis

dbt

Airflow

GCP

AWS

Spark

Apache Beam

Terraform

Kubernetes

Job description

We're looking for a Senior Data Engineer to join our Data Platform team and help build the foundations that power Curve's data-driven culture. Working across both real-time and batch data platforms, you'll design, build and operate scalable data infrastructure that collects, processes and serves data from a wide range of internal and external sources. You'll play a key role in ensuring the reliability, performance and availability of our data warehouse and data pipelines, enabling cutting-edge analytics, machine learning, real-time decisioning and operational reporting. Collaborating closely with engineers, data scientists, machine learning researchers and business stakeholders, you'll help shape the future of our data platform while promoting best practice in data engineering, architecture and quality.

Qualifications

• At least 5 years' experience as a Data Engineer working with real-time and batch data in production environments
• Strong experience with streaming technologies such as Kafka, Pub/Sub or Kinesis
• Solid understanding of data warehousing principles including relational modelling, query optimisation and administration
• Strong programming experience with Python, Go and/or SQL
• Experience using dbt for data modelling and transformation
• Experience working with Apache Airflow or similar orchestration tooling
• Proven experience designing and building production systems on GCP and/or AWS
• Strong understanding of event-driven architectures and distributed systems
• Experience deploying and supporting batch and real-time machine learning workloads
• Experience working with distributed processing technologies such as Spark or Apache Beam
• Strong understanding of data quality principles and engineering best practices
• Experience optimising database performance, troubleshooting issues and maintaining production data systems
• Ability to learn new technologies quickly and apply them pragmatically in a fast-moving environment

And it would be great if you had any of the following:

• Experience developing or supporting machine learning solutions
• Experience with Terraform and Infrastructure as Code
• Experience with Kubernetes and containerised environments
• Experience working with LLMs and agentic workflows
• Experience mentoring or supporting other engineers
• Strong understanding of large-scale distributed architecture patterns
• Knowledge of security and information security considerations within data engineering
• Experience within Fintech, Financial Services, Payments or Retail Banking

At Lloyds Banking Group, we're driven by a clear purpose; to help Britain prosper. Across the Group, our colleagues are focused on making a difference to customers, businesses and communities. With us you'll have a key role to play in shaping the financial services of the future, whilst the scale and reach of our Group means you'll have many opportunities to learn, grow and develop.

We keep your data safe. So, we'll only ever ask you to provide confidential or sensitive information once you have formally been invited along to an interview or accepted a verbal offer to join us which is when we run our background checks. We'll always explain what we need and why, with any request coming from a trusted Lloyds Banking Group person. We're focused on creating a values-led culture and are committed to building a workforce which reflects the diversity of the customers and communities we serve. Together we're building a truly inclusive workplace where all of our colleagues have the opportunity to make a real difference.

Our ambition is to be the leading UK business for diversity, equity and inclusion, supporting our customers, colleagues and communities. We are committed to creating an environment in which everyone can thrive, learn and develop. We were one of the first major organisations to set goals on diversity in senior roles, create a menopause health package, and launch a dedicated Working with Cancer initiative. We offer reasonable workplace adjustments for colleagues with disabilities, including flexibility in office attendance, location and working patterns. As a Disability Confident Leader, we guarantee interviews for a fair and proportionate number of applicants who meet the minimum criteria for the role and have a disability, long-term health or neurodivergent condition, through the Disability Confident Scheme. We provide reasonable adjustments throughout the recruitment process to reduce or remove barriers - just let us know what you need.

We also offer a wide-ranging benefits package, which includes…

• A generous pension contribution of up to 15%
• An annual bonus award, subject to Group performance
• Share schemes including free shares
• Benefits you can adapt to your lifestyle, such as discounted shopping
• 30 days' holiday, with bank holidays on top
• A range of wellbeing initiatives and generous parental leave policies