Real-Time Data Engineering Lead

HSBC Group; Sheffield; Hybrid; GBP 90,000 - 130,000; Full time

Job summary

HSBC Group in the United Kingdom seeks a Real-Time Data Engineering Lead to own the technical direction of scalable, low-latency data flows across global markets. You will architect event-driven ingestion and transformation pipelines, oversee 24x7 production operations and set standards for data quality, privacy and security.

Strong leadership, experience with Kafka/Flink/Spark, Google Cloud, and regulated domains such as financial crime are essential.

Qualifications

• Experience building high-volume, low-latency data platforms.
• Expertise in real-time data processing and streaming architectures.
• Strong leadership and collaboration with risk, compliance and AI teams.

Responsibilities

• Own the technical direction and delivery of scalable, low-latency data flows across HSBC's global markets.
• Architect event-driven solutions for transaction ingestion, transformation and delivery into monitoring, decisioning and intervention services.
• Lead engineering teams to build highly available, observable streaming platforms that perform reliably at peak volume.
• Set standards for data quality, lineage, privacy, security, performance and operational resilience.
• Make architectural trade-offs; act as senior escalation point; partner with product and AI teams to productionise advanced analytics.
• Influence the data platform roadmap while coaching senior engineers and fostering ownership.

Skills

Kafka

Flink

Spark

Real-time data processing

Event-driven architectures

Distributed systems

Google Cloud

CI/CD

Observability

Security

DevSecOps

Leadership

Financial crime domain knowledge

Regulatory compliance awareness

Tools

Google Cloud Platform

Job description

• Own the technical direction and delivery of scalable, low-latency data flows across HSBC's global markets
• Architect event-driven solutions for transaction ingestion, transformation, enrichment and delivery into monitoring, decisioning and intervention services
• Lead engineering teams to build highly available, observable and recoverable streaming platforms that perform predictably at peak volume
• Set standards for data quality, lineage, privacy, security, performance, capacity management and operational resilience
• Make clear architectural trade-offs across latency, accuracy, portability, cost and control; act as the senior technical escalation point for complex platform issues; and partner with product and AI teams to turn advanced analytics, agentic AI and responsible automated intervention into controlled production capability
• Influence the wider financial crime technology roadmap while coaching senior engineers and building a culture of ownership and technical excellence
  Deep expertise in real-time data processing, streaming architectures and event-driven systems using technologies such as Kafka, Flink, Spark or equivalent
• Strong experience of enterprise integration, distributed systems and transformation patterns for high-volume, low-latency and highly available services
• Proven delivery of complex data platforms from architecture through to reliable 24x7 production operation
• Production experience with Google Cloud including performance and cost optimisation
• Strong engineering judgement across observability, resilience, data quality, security, DevSecOps and CI/CD
• Experience leading senior technical teams and influencing business, risk, compliance and technology stakeholders
• Knowledge of transaction monitoring, sanctions, AML, responsible AI, explainability or another highly regulated domain is highly valuable
  If you're looking for a career that will help you stand out, join HSBC, and fulfil your potential - whether you want a career that could take you to the top, or an exciting new direction, we offer opportunities, support and rewards that will take you further.

We're one of the largest banking and financial services organisations in the world, with a network that covers more than 50 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people fulfil their hopes and realisetheir ambitions. We're currently seeking an experienced professional to join our Risk and Compliance team in the role of Real-Time Data Engineering Lead. You'll play a key role in shaping and delivering HSBC's next generation of financial crime prevention. This role will lead the engineering of high-volume, low-latency data flows that transform global transaction events into trusted, actionable intelligence in real time. Working across engineering, architecture, cloud, security, product, AI and financial crime teams, the role will help HSBC detect threats earlier, intervene faster and increasingly prevent financial crime before it occurs.

Being open to different points of view is important for our business and the communities we serve. At HSBC, we're dedicated to creating diverse and inclusive workplaces - no matter their gender, ethnicity, disability, religion, sexual orientation, socio-economic background or age. We are committed to removing barriers and ensuring careers at HSBC are inclusive and accessible for everyone to be at their best. We take pride in being a Disability Confident Leader and will offer an interview to people with disabilities, long term conditions or neurodivergent candidates who meet the minimum criteria for the role.

As an HSBC employee in the UK, you'll have access to tailored professional development opportunities and a competitive pay and benefits package. This includes private healthcare for all UK-based employees, enhanced maternity and adoption pay and support when you return to work, and a contributory pension scheme with a generous employer contribution.