Senior Data Engineer (GCP/Kafka)

Lloyds Banking Group; Bristol; Hybrid; GBP 70,000 - 87,000; Full time

Job summary

An established industry player is seeking a Senior Data Engineer to enhance their data capabilities. In this role, you will build reusable data pipelines and work with both structured and unstructured data to deliver real-time insights. You will leverage your expertise in cloud technologies and big data frameworks while mentoring fellow engineers. This hybrid position offers a dynamic environment where innovation thrives, and your contributions will directly impact the customer experience. Join a forward-thinking organization committed to inclusivity and diversity, and be part of a team that is shaping the future of banking.

Benefits

Generous pension contribution of up to 15%

Annual performance-related bonus

Share schemes including free shares

Discounted shopping benefits

30 days' holiday plus bank holidays

Wellbeing initiatives

Generous parental leave policies

Qualifications

• Experience in coding/scripting in Python, Java, Scala, or Go.
• Strong experience with Kafka and big data technologies.
• Proficiency in cloud platforms like GCP, AWS, or Azure.

Responsibilities

• Build reusable data pipelines and work with structured/unstructured data.
• Mentor engineers and adopt best engineering practices.
• Design and build scalable real-time data applications.

Skills

Python

Java

Scala

Go

SQL

Kafka

Hadoop

Spark

Terraform

CI/CD

Education

Certification in GCP Professional Data Engineer

Certification in Apache Kafka (CCDAK)

Tools

Docker

Kubernetes

GCP

AWS

Azure

Job description

JOB TITLE: Senior Data Engineer

SALARY: Bristol £70,930 - £86,690 per annum | London £82,000 - £100,200 per annum

LOCATION(S): Bristol or London

HOURS: Full-time - 35 hours per week

WORKING PATTERN: Our work style is hybrid, which involves spending at least two days per week currently, or 40% of our time, at our Bristol or London office.

Please note that we will not be able to support a visa application for these roles on this occasion, so all candidates should have a legal right to work in the UK without requiring sponsorship, to be considered for this position.

ABOUT THIS OPPORTUNITY

A great opportunity has arisen for a Data Engineer to work within the Personalised Experiences and Communications Platform to join product engineering cross functional teams. As a Data Engineer your responsibilities will be delivering the highest quality data capability, drawing upon your engineering expertise, whilst being open minded to the opportunities the cloud provides.

What you'll be doing

• Building reusable data pipelines at scale, work with structured and unstructured data, and feature engineering for machine learning or curate data to provide real time contextualise insights to power our customers journeys.
• Using industry leading toolsets, as well as evaluating exciting new technologies to design and build scalable real time data applications.
• Spanning the full data lifecycle and experience using mix of modern and traditional data platforms (e.g. Hadoop, Kafka, GCP, Azure, Teradata, SQL server) you'll get to work building capabilities with horizon-expanding exposure to a host of wider technologies and careers in data.
• Helping in adopting best engineering practices like Test Driven Development, code reviews, Continuous Integration/Continuous Delivery etc for data pipelines.
• Mentoring other engineers to deliver high quality and data led solutions for our Bank's customers.

ABOUT US

Like the modern Britain we serve, we're evolving. Investing billions in our people, data and tech to transform the way we meet the ever-changing needs of our 26 million customers. We're growing with purpose. Join us on our journey and you will too.

WHAT WE NEED YOU TO HAVE EXPERIENCE IN

Coding

• Coding/scripting experience developed in a commercial/industry setting (Python, Java, Scala or Go and SQL).

Databases & frameworks

• Strong experience working with Kafka technologies.
• Working experience with operational data stores, data warehouse, big data technologies and data lakes.
• Experience working with relational and non-relational databases to build data solutions, such as SQL Server/Oracle, experience with relational and dimensional data structures.
• Experience in using distributed frameworks (Spark, Flink, Beam, Hadoop).
• Proficiency in infrastructure as code (IaC) using Terraform.
• Experience with CI/CD pipelines and related tools/frameworks.

Containerisation

• Good knowledge of containers (Docker, Kubernetes etc).

Cloud

• Experience with GCP, AWS or Azure.
• Good understanding of cloud storage, networking and resource provisioning.

It would be great if you had

• Certification in GCP "Professional Data Engineer".
• Certification in Apache Kafka (CCDAK).
• Proficiency across the data lifecycle.

WORKING FOR US

Our focus is to ensure we are inclusive every day, building an organisation that reflects modern society and celebrates diversity in all its forms.

We want our people to feel that they belong and can be their best, regardless of background, identity, or culture. We were one of the first major organisations to set goals on diversity in senior roles, create a menopause health package, and a dedicated Working with Cancer initiative. And it is why we especially welcome applications from under-represented groups and cognitively diverse individuals. We are disability confident and want to ensure we support you to showcase your best self. So, if you are neurodivergent or have any other reason to would like reasonable adjustments to be made to our recruitment processes, just let us know.

We also offer a wide-ranging benefits package, which includes:

• A generous pension contribution of up to 15%.
• An annual performance-related bonus.
• Share schemes including free shares.
• Benefits you can adapt to your lifestyle, such as discounted shopping.
• 30 days' holiday, with bank holidays on top.
• A range of wellbeing initiatives and generous parental leave policies.

Ready for a career where you can have a positive impact as you learn, grow, and thrive? Apply today and find out more.

Join our journey!