Data & ML Platform Lead for Real-Time Banking

Lloyds Banking Group; Greater London; Hybrid; GBP 107,000 - 126,000; Full time

Benefits offered by this job

Pension up to 15%

Annual bonus

Share schemes

Discounts

30 days holiday

Wellbeing initiatives

Job summary

Lloyds Banking Group is seeking a Data & ML Platform Lead in London to steer a hybrid, hands‑on platform engineering team responsible for core data ingestion, real‑time decisioning and ML capability platforms. The role demands strong leadership, cloud‑native design, and production reliability in a regulated banking environment.

You will shape architecture for streaming pipelines, feature stores, and scalable data services, aligning with bank‑grade standards while collaborating across Curve

Qualifications

• Significant experience in data engineering, platform engineering or similar roles with leadership to engineers.
• Deep production experience with streaming technologies, ideally Kafka, and event‑driven architectures at scale.
• Proven experience designing and operating production systems on GCP (BigQuery, Managed Airflow, Cloud Run, Dataflow).
• Strong programming ability in Python and experience with at least one systems language (Go preferred).
• Experience building/operating real‑time services and batch/streaming data pipelines.

Responsibilities

• Lead and develop a multidisciplinary platform engineering team.
• Own the design and reliability of Kafka‑based decisioning services and data pipelines.
• Ensure platform operates to bank‑grade reliability, auditability and scale within Lloyds Banking Group integration.
• Oversee cloud infrastructure and orchestration, including Terraform, Kubernetes and Airflow in production.

Skills

Data engineering

Platform engineering

Kafka

GCP

Python

Terraform

Kubernetes

Airflow

ML systems

Observability

Tools

BigQuery

Managed Airflow

Cloud Run

Dataflow

Terraform

Job description

Lloyds Banking Group is seeking a Data & ML Platform Lead in London to steer a hybrid, hands‑on platform engineering team responsible for core data ingestion, real‑time decisioning and ML capability platforms. The role demands strong leadership, cloud‑native design, and production reliability in a regulated banking environment.

You will shape architecture for streaming pipelines, feature stores, and scalable data services, aligning with bank‑grade standards while collaborating across Curve