Data Engineering Lead (Hybrid)

HSBC Group; Sheffield; On-site; GBP 90,000 - 120,000; Full time

Job summary

HSBC Group is seeking a Data Engineering Lead to join the Wholesale Data & Analytics team. You will guide the delivery of data platforms, liaise with stakeholders, and own end-to-end development from design through to production and support.

The role requires strong data warehousing, Hadoop/Spark, and programming skills in Scala and Python, with hands-on leadership and a focus on automated testing and modern engineering practices.

Qualifications

• Experience delivering data warehouse and production data platforms.
• Strong background with Hadoop or Spark based data processing.
• Proficiency in Scala and Python for data pipelines.
• Hands-on with versioning, CI/CD tooling and code reviews.
• Understanding of Agile methodologies and modern engineering practices.

Responsibilities

• Lead from the front, owning end-to-end delivery from analysis to production.
• Collaborate with stakeholders to translate business requirements into technical design.
• Provide technical SME guidance and solve complex problems.
• Ensure automated testing and robust deployment practices are in place.
• Drive continual service improvement and scalable data solutions.
• Mentor team members and promote best engineering practices.

Skills

Data Warehouse processes

Big Data (Hadoop/Spark)

Scala

Python

GitHub

Jenkins

Ansible

JIRA

Agile (Scrum/Kanban)

CI/CD

Tools

GitHub

Jenkins

Ansible

JIRA

Job description

• Technically lead team and liaise with business stakeholders to ensure that business requirements are fully understood before commencing design and development. Hands-on coding and helping team members solve technical problems and provide technical SME knowledge and guidance.
• Understand and design of the application and own any changes required to the application for any new requirements & ensure it complies with department standards.
• Forward thinking for new technologies and required accessibility.
• Guide developers in implementing best-of-breed technical solutions based on agreed technical design, adopting industry standard development patterns and methodologies (including continuous integration and automated unit and integration testing)
• Responsible for ensuring implemented solutions have sufficient and appropriate automated testing in advance of User Acceptance Testing
• Managing continual service improvement - ensuring incremental improvements to the Service, corrective measures to recover service performance, and eventually the demise of the Service when it is no longer required.
• Lead from the front and demonstrate excellence in owning the end-to-end delivery of software from analysis through to release to production and support. We deliver each change to production before moving onto the next

To be successful in this role you should have the following skills:

• Experience implementing data processes for Data Warehouse and production systems.
• Strong experience with Big Data technologies (e.g., Hadoop / Spark).
• Programming in modern languages (e.g., Scala and Python).
• Strong delivery engineering tooling: Git/GitHub, Jenkins, Ansible, and JIRA for requirement/backlog management.
• Strong understanding of software development methodologies (including Agile such as Scrum/Kanban) and modern engineering practices (CI/CD, automated testing).

Being open to different points of view is important for our business and the communities we serve. At HSBC, we're dedicated to creating diverse and inclusive workplaces - no matter their gender, ethnicity, disability, religion, sexual orientation, socio-economic background or age. We are committed to removing barriers and ensuring careers at HSBC are inclusive and accessible for everyone to be at their best. We take pride in being a Disability Confident Leader and will offer an interview to people with disabilities, long term conditions or neurodivergent candidates who meet the minimum criteria for the role.

If you're looking for a career that will help you stand out, join HSBC, and fulfil your potential - whether you want a career that could take you to the top, or an exciting new direction, we offer opportunities, support and rewards that will take you further. We're one of the largest banking and financial services organisations in the world, with a network that covers more than 50 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people fulfil their hopes and realise their ambitions. We are seeking a Data Engineering Lead to join our Wholesale Data & Analytics team. Wholesale Data & Analytics is an initiative that is part of the Group Data Strategy to transform the way we govern, manage and use all our data to its full potential across HSBC. If you like solving messy cross-functional problems, influencing in a matrix, and leaving things stronger than you found them, this role gives you visibility, impact, and a fast-learning curve. A move across the business allows you to continue to access tailored professional development opportunities, and our fantastic benefits packages.