Data Engineering Lead: End-to-End Data & Platform Delivery

HSBC Group; Sheffield; On-site; GBP 90,000 - 120,000; Full time

Job summary

HSBC Group is seeking a Data Engineering Lead to join the Wholesale Data & Analytics team. You will guide the delivery of data platforms, liaise with stakeholders, and own end-to-end development from design through to production and support.

The role requires strong data warehousing, Hadoop/Spark, and programming skills in Scala and Python, with hands-on leadership and a focus on automated testing and modern engineering practices.

Qualifications

• Experience delivering data warehouse and production data platforms.
• Strong background with Hadoop or Spark based data processing.
• Proficiency in Scala and Python for data pipelines.
• Hands-on with versioning, CI/CD tooling and code reviews.
• Understanding of Agile methodologies and modern engineering practices.

Responsibilities

• Lead from the front, owning end-to-end delivery from analysis to production.
• Collaborate with stakeholders to translate business requirements into technical design.
• Provide technical SME guidance and solve complex problems.
• Ensure automated testing and robust deployment practices are in place.
• Drive continual service improvement and scalable data solutions.
• Mentor team members and promote best engineering practices.

Skills

Data Warehouse processes

Big Data (Hadoop/Spark)

Scala

Python

GitHub

Jenkins

Ansible

JIRA

Agile (Scrum/Kanban)

CI/CD

Tools

GitHub

Jenkins

Ansible

JIRA

Job description

HSBC Group is seeking a Data Engineering Lead to join the Wholesale Data & Analytics team. You will guide the delivery of data platforms, liaise with stakeholders, and own end-to-end development from design through to production and support.

The role requires strong data warehousing, Hadoop/Spark, and programming skills in Scala and Python, with hands-on leadership and a focus on automated testing and modern engineering practices.