Senior Data Engineer (GCP/Kafka)

Lloyds Bank plc; Bristol; Hybrid; GBP 68,000 - 76,000; Full time

Job summary

An established industry player is seeking a Senior Data Engineer to join their innovative team. In this role, you will leverage your expertise in cloud technologies and data engineering to build scalable data pipelines and applications. You will work with cutting-edge tools and technologies, including GCP and Kafka, to drive real-time insights that enhance customer experiences. This is an exciting opportunity to contribute to a forward-thinking organization that values diversity and inclusion. If you're passionate about data and want to make a meaningful impact, this role is perfect for you!

Benefits

Generous pension contribution up to 15%

Annual performance-related bonus

Share schemes including free shares

Discounted shopping benefits

30 days’ holiday plus bank holidays

Wellbeing initiatives

Generous parental leave policies

Qualifications

• Experience in coding/scripting in Python, Java, Scala, Go, and SQL.
• Strong experience with Kafka and big data technologies.
• Proficiency in infrastructure as code using Terraform.

Responsibilities

• Build reusable data pipelines for structured and unstructured data.
• Design and build scalable real-time data applications.
• Mentor engineers to deliver high-quality data solutions.

Skills

Python

Java

Scala

Go

SQL

Kafka

Hadoop

Spark

Flink

Beam

Education

Certification in GCP Professional Data Engineer

Certification in Apache Kafka (CCDAK)

Tools

Docker

Kubernetes

Terraform

CI/CD pipelines

GCP

AWS

Azure

Job description

Senior Data Engineer (GCP/Kafka)

Apply locations: Bristol Harbourside, London 25 Gresham Street

Time type: Full time

Posted on: Posted Yesterday

Time left to apply: End Date: May 12, 2025 (25 days left to apply)

Job requisition id: 111909

End Date: Sunday 11 May 2025

Salary Range: £68,202 - £75,780

Flexible Working Options: Hybrid Working, Job Share

Job Description Summary:

A great opportunity has arisen for a Data Engineer to work within the Personalised Experiences and Communications Platform to join product engineering cross functional teams. As a Data Engineer, your responsibilities will include delivering the highest quality data capability, drawing upon your engineering expertise, whilst being open-minded to the opportunities the cloud provides.

What you’ll be doing…

• Building reusable data pipelines at scale, working with structured and unstructured data, and feature engineering for machine learning or curating data to provide real-time contextual insights to power our customers' journeys.
• Using industry-leading toolsets, as well as evaluating exciting new technologies to design and build scalable real-time data applications.
• Spanning the full data lifecycle and experience using a mix of modern and traditional data platforms (e.g. Hadoop, Kafka, GCP, Azure, Teradata, SQL server) you’ll get to work building capabilities with horizon-expanding exposure to a host of wider technologies and careers in data.
• Helping in adopting best engineering practices like Test Driven Development, code reviews, Continuous Integration/Continuous Delivery for data pipelines.
• Mentoring other engineers to deliver high-quality and data-led solutions for our Bank’s customers.

What we need you to have experience in:

Coding:

• Coding/scripting experience developed in a commercial/industry setting (Python, Java, Scala or Go, and SQL).

Databases & frameworks:

• Strong experience working with Kafka technologies.
• Working experience with operational data stores, data warehouse, big data technologies, and data lakes.
• Experience working with relational and non-relational databases to build data solutions, such as SQL Server/Oracle, experience with relational and dimensional data structures.
• Experience in using distributed frameworks (Spark, Flink, Beam, Hadoop).
• Proficiency in infrastructure as code (IaC) using Terraform.
• Experience with CI/CD pipelines and related tools/frameworks.

Containerisation:

• Good knowledge of containers (Docker, Kubernetes etc).

Cloud:

• Experience with GCP, AWS, or Azure.
• Good understanding of cloud storage, networking, and resource provisioning.

It would be great if you had…

• Certification in GCP “Professional Data Engineer”.
• Certification in Apache Kafka (CCDAK).
• Proficiency across the data lifecycle.

Working for us:

Our focus is to ensure we are inclusive every day, building an organisation that reflects modern society and celebrates diversity in all its forms. We want our people to feel that they belong and can be their best, regardless of background, identity, or culture. We were one of the first major organisations to set goals on diversity in senior roles, create a menopause health package, and a dedicated Working with Cancer initiative. And it is why we especially welcome applications from under-represented groups and cognitively diverse individuals.

We also offer a wide-ranging benefits package, which includes:

• A generous pension contribution of up to 15%.
• An annual performance-related bonus.
• Share schemes including free shares.
• Benefits you can adapt to your lifestyle, such as discounted shopping.
• 30 days’ holiday, with bank holidays on top.
• A range of wellbeing initiatives and generous parental leave policies.

Ready for a career where you can have a positive impact as you learn, grow, and thrive? Apply today and find out more.

Join our journey!

At Lloyds Banking Group, we're driven by a clear purpose; to help Britain prosper. Across the Group, our colleagues are focused on making a difference to customers, businesses, and communities. With us, you'll have a key role to play in shaping the financial services of the future, whilst the scale and reach of our Group means you'll have many opportunities to learn, grow, and develop.

We keep your data safe. So, we'll only ever ask you to provide confidential or sensitive information once you have formally been invited along to an interview or accepted a verbal offer to join us which is when we run our background checks. We'll always explain what we need and why, with any request coming from a trusted Lloyds Banking Group person.

We're focused on creating a values-led culture and are committed to building a workforce which reflects the diversity of the customers and communities we serve. Together we’re building a truly inclusive workplace where all of our colleagues have the opportunity to make a real difference.