Senior Data Engineer - Real-Time Pipelines (GCP/Kafka)

Lloyds Banking Group; West of England; On-site; GBP 50,000 - 75,000; Full time

Benefits offered by this job

Generous pension contribution of up to 15%

Annual performance-related bonus

30 days' holiday plus bank holidays

Wellbeing initiatives and generous parental leave policies

Job summary

A leading banking institution is seeking a Senior Data Engineer to enhance their data capabilities within the Personalised Experiences and Communications Platform. This role involves building data pipelines, mentoring junior engineers, and leveraging cloud technologies to deliver high-quality data solutions. Join a diverse team focused on innovation and excellence, while enjoying a hybrid work model and a comprehensive benefits package.

Qualifications

• Experience in coding/scripting in Python, Java, Scala or Go.
• Strong experience with Kafka and data warehouse technologies.
• Proficiency in using distributed frameworks like Spark and Hadoop.

Responsibilities

• Build reusable data pipelines and work with structured/unstructured data.
• Mentor other engineers and adopt best engineering practices.
• Design and build scalable real-time data applications.

Skills

Python

Java

Kafka

SQL

Docker

Kubernetes

Education

Certification in GCP 'Professional Data Engineer'

Certification in Apache Kafka (CCDAK)

Tools

Terraform

Hadoop

Spark

Flink

Beam

Job description

This position is no longer open for applications

Salary: GBP70000 - GBP86700 per annum

LOCATION(S): Bristol

HOURS: Full-time – 35 hours per week

WORKING PATTERN: Our work style is hybrid, which involves spending at least two days per week currently, or 40% of our time, at our Bristol office.

Please note that we will not be able to support a visa application for these roles on this occasion, so all candidates should have a legal right to work in the UK without requiring sponsorship, to be considered for this position.

ABOUT THIS OPPORTUNITY

A great opportunity has arisen for a Data Engineer to work within the Personalised Experiences and Communications Platform to join product engineering cross functional teams. As a Data Engineer your responsibilities will be delivering the highest quality data capability, drawing upon your engineering expertise, whilst being open minded to the opportunities the cloud provides.

What you’ll be doing…

Building reusable data pipelines at scale, work with structured and unstructured data, and feature engineering for machine learning or curate data to provide real time contextualise insights to power our customers journeys.

Using industry leading toolsets, as well as evaluating exciting new technologies to design and build scalable real time data applications.

Spanning the full data lifecycle and experience using mix of modern and traditional data platforms (e.g. Hadoop, Kafka, GCP, Azure, Teradata, SQL server) you’ll get to work building capabilities with horizon-expanding exposure to a host of wider technologies and careers in data.

Helping in adopting best engineering practices like Test Driven Development, code reviews, Continuous Integration/Continuous Delivery etc for data pipelines.

Mentoring other engineers to deliver high quality and data led solutions for our Bank’s customers

ABOUT US

Like the modern Britain we serve, we’re evolving. Investing billions in our people, data and tech to transform the way we meet the ever-changing needs of our 26 million customers. We’re growing with purpose. Join us on our journey and you will too…

WHAT WE NEED YOU TO HAVE EXPERIENCE IN

Coding

Coding/scripting experience developed in a commercial/industry setting (Python, Java, Scala or Go and SQL)

Databases & frameworks

Strong experience working with Kafka technologies

Working experience with operational data stores, data warehouse, big data technologies and data lakes

Experience working with relational and non-relational databases to build data solutions, such as SQL Server/Oracle, experience with relational and dimensional data structures

Experience in using distributed frameworks (Spark, Flink, Beam, Hadoop)

Proficiency in infrastructure as code (IaC) using Terraform

Experience with CI/CD pipelines and related tools/frameworks

Containerisation

Good knowledge of containers (Docker, Kubernetes etc)

Cloud

Experience with GCP, AWS or Azure

Good understating of cloud storage, networking and resource provisioning

It would be great if you had…

Certification in GCP “Professional Data Engineer”

Certification in Apache Kafka (CCDAK)

Proficiency across the data lifecycle

WORKING FOR US

Our focus is to ensure we are inclusive every day, building an organisation that reflects modern society and celebrates diversity in all its forms.

We want our people to feel that they belong and can be their best, regardless of background, identity, or culture. We were one of the first major organisations to set goals on diversity in senior roles, create a menopause health package, and a dedicated Working with Cancer initiative. And it is why we especially welcome applications from under-represented groups and cognitively diverse individuals. We are disability confident and want to ensure we support you to showcase your best self. So, if you are neurodivergent or have any other reason to would like reasonable adjustments to be made to our recruitment processes, just let us know.

We also offer a wide-ranging benefits package, which includes:

A generous pension contribution of up to 15%

An annual performance-related bonus

Share schemes including free shares.

Benefits you can adapt to your lifestyle, such as discounted shopping.

30 days’ holiday, with bank holidays on top

A range of wellbeing initiatives and generous parental leave policies

Ready for a career where you can have a positive impact as you learn, grow, and thrive? Apply today and find out more.

Name:

Please include your first and last name.

Email: @

Phone:

Please include your country code.

CV / Resume:
supported file types: .doc .docx .odt .pdf .rtf .txt

Yes, I am currently eligible to work (work permit/visa/citizenship) in the country to which I am applying. No, I am not currently eligible to work (work permit/visa/citizenship) in the country to which I am applying.