Data Engineering Lead (Hybrid)

HSBC; Sheffield; On-site; GBP 90,000 - 130,000; Full time

Job summary

HSBC is seeking a Data Engineering Lead to join our Wholesale Data & Analytics team. You will technically lead the team, liaise with business stakeholders, and ensure requirements are understood before design and development.

The role focuses on data warehouse and large‑scale data processing using Big Data technologies (Hadoop, Spark), with programming in Scala and Python. You will guide developers, implement best practices, and drive automated testing and CI/CD to production.

Qualifications

• Experience implementing data processes for Data Warehouse and production systems.
• Strong experience with Big Data technologies (e.g., Hadoop / Spark).
• Programming in modern languages (e.g., Scala and Python).
• Strong delivery engineering tooling: Git/GitHub, Jenkins, Ansible, and JIRA for requirement/backlog management.
• Strong understanding of software development methodologies (including Agile such as Scrum/Kanban) and modern engineering practices (CI/CD, automated testing).

Responsibilities

• Technically lead team and liaise with business stakeholders to ensure that business requirements are fully understood before commencing design and development.
• Hands‑on coding and helping team members solve technical problems and provide technical SME knowledge and guidance.
• Understand and design of the application and own any changes required to the application for any new requirements and ensure it complies with department standards.
• Forward thinking for new technologies and required accessibility.
• Guide developers in implementing best‑of‑breed technical solutions based on agreed technical design, adopting industry standard development patterns and methodologies (including continuous integration and automated unit and integration testing).
• Responsible for ensuring implemented solutions have sufficient and appropriate automated testing in advance of User Acceptance Testing.
• Managing continual service improvement – ensuring incremental improvements to the Service, corrective measures to recover service performance, and eventually the demise of the Service when it is no longer required.
• Lead from the front and demonstrate excellence in owning the end‑to‑end delivery of software from analysis through to release to production and support.

Skills

Data Warehouse experience

Big Data

Scala

Python

Agile methodologies

CI/CD & automated testing

Tools

Git/GitHub

Jenkins

Ansible

JIRA

Job description

If you’re looking for a career that will help you stand out, join HSBC, and fulfil your potential - whether you want a career that could take you to the top, or an exciting new direction, we offer opportunities, support and rewards that will take you further.

We’re one of the largest banking and financial services organisations in the world, with a network that covers more than 50 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people fulfil their hopes and realise their ambitions.

We are seeking a Data Engineering Lead to join our Wholesale Data & Analytics team.

Wholesale Data & Analytics is an initiative that is part of the Group Data Strategy to transform the way we govern, manage and use all our data to its full potential across HSBC.

If you like solving messy cross-functional problems, influencing in a matrix, and leaving things stronger than you found them, this role gives you visibility, impact, and a fast-learning curve.

A move across the business allows you to continue to access tailored professional development opportunities, and our fantastic benefits packages.

In this role, you will:

• Technically lead team and liaise with business stakeholders to ensure that business requirements are fully understood before commencing design and development. Hands‑on coding and helping team members solve technical problems and provide technical SME knowledge and guidance.
• Understand and design of the application and own any changes required to the application for any new requirements & ensure it complies with department standards.
• Forward thinking for new technologies and required accessibility.
• Guide developers in implementing best‑of‑breed technical solutions based on agreed technical design, adopting industry standard development patterns and methodologies (including continuous integration and automated unit and integration testing)
• Responsible for ensuring implemented solutions have sufficient and appropriate automated testing in advance of User Acceptance Testing
• Managing continual service improvement – ensuring incremental improvements to the Service, corrective measures to recover service performance, and eventually the demise of the Service when it is no longer required.
• Lead from the front and demonstrate excellence in owning the end‑to‑end delivery of software from analysis through to release to production and support. We deliver each change to production before moving onto the next

To be successful in this role you should have the following skills:

• Experience implementingdata processes for Data Warehouse and production systems.
• Strong experience withBig Data technologies(e.g.,Hadoop / Spark).
• Programming in modern languages (e.g.,ScalaandPython).
• Strong delivery engineering tooling:Git/GitHub,Jenkins,Ansible, andJIRAfor requirement/backlog management.
• Strong understanding ofsoftware development methodologies(includingAgilesuch as Scrum/Kanban) and modern engineering practices (CI/CD, automated testing).

Being open to different points of view is important for our business and the communities we serve. At HSBC, we’re dedicated to creating diverse and inclusive workplaces - no matter their gender, ethnicity, disability, religion, sexual orientation, socio-economic background or age. We are committed to removing barriers and ensuring careers at HSBC are inclusive and accessible for everyone to be at their best. We take pride in being a Disability Confident Leader and will offer an interview to people with disabilities, long term conditions or neurodivergent candidates who meet the minimum criteria for the role.

If you have a need that requires accommodations or changes during the recruitment process, please get in touch with our Recruitment Helpdesk via [e-mail] .