Data Engineering Lead - End-to-End Delivery Leader

HSBC; Sheffield; On-site; GBP 90,000 - 130,000; Full time

Job summary

HSBC is seeking a Data Engineering Lead to join our Wholesale Data & Analytics team. You will technically lead the team, liaise with business stakeholders, and ensure requirements are understood before design and development.

The role focuses on data warehouse and large‑scale data processing using Big Data technologies (Hadoop, Spark), with programming in Scala and Python. You will guide developers, implement best practices, and drive automated testing and CI/CD to production.

Qualifications

• Experience implementing data processes for Data Warehouse and production systems.
• Strong experience with Big Data technologies (e.g., Hadoop / Spark).
• Programming in modern languages (e.g., Scala and Python).
• Strong delivery engineering tooling: Git/GitHub, Jenkins, Ansible, and JIRA for requirement/backlog management.
• Strong understanding of software development methodologies (including Agile such as Scrum/Kanban) and modern engineering practices (CI/CD, automated testing).

Responsibilities

• Technically lead team and liaise with business stakeholders to ensure that business requirements are fully understood before commencing design and development.
• Hands‑on coding and helping team members solve technical problems and provide technical SME knowledge and guidance.
• Understand and design of the application and own any changes required to the application for any new requirements and ensure it complies with department standards.
• Forward thinking for new technologies and required accessibility.
• Guide developers in implementing best‑of‑breed technical solutions based on agreed technical design, adopting industry standard development patterns and methodologies (including continuous integration and automated unit and integration testing).
• Responsible for ensuring implemented solutions have sufficient and appropriate automated testing in advance of User Acceptance Testing.
• Managing continual service improvement – ensuring incremental improvements to the Service, corrective measures to recover service performance, and eventually the demise of the Service when it is no longer required.
• Lead from the front and demonstrate excellence in owning the end‑to‑end delivery of software from analysis through to release to production and support.

Skills

Data Warehouse experience

Big Data

Scala

Python

Agile methodologies

CI/CD & automated testing

Tools

Git/GitHub

Jenkins

Ansible

JIRA

Job description

HSBC is seeking a Data Engineering Lead to join our Wholesale Data & Analytics team. You will technically lead the team, liaise with business stakeholders, and ensure requirements are understood before design and development.

The role focuses on data warehouse and large‑scale data processing using Big Data technologies (Hadoop, Spark), with programming in Scala and Python. You will guide developers, implement best practices, and drive automated testing and CI/CD to production.