Data Platform Engineer — Pipelines & Self‑Service Data

Barclays; Greater London; Hybrid; GBP 85,000 - 130,000; Full time

Job summary

Barclays in London is seeking a Data Engineer to build and operate production-grade data pipelines on Databricks and AWS, delivering scalable data products for a standalone payments platform.

You will collaborate with data scientists, apply Unity Catalog governance, and drive platform automation with Terraform and GitHub Actions, in a hybrid work pattern with three days in the office. Based in London, you will join a growing team at Barclays' offices in central locations.

Qualifications

• Hands-on experience building production-grade Databricks platforms and pipelines.
• Modular, testable components with CI/CD and Git workflows.
• Experience configuring Unity Catalog for governance and data access control.

Responsibilities

• Build and maintain data architectures and pipelines for durable, complete data.
• Design data warehouses and data lakes with appropriate security and scale.
• Collaborate with data scientists to deploy machine learning models.
• Lead or contribute to data platform strategy and governance improvements.
• Define jobs, allocate resources, and ensure budgets align with policies.

Skills

Databricks pipelines

Python

PySpark

SQL

CI/CD

Terraform

GitHub Actions

Unity Catalog

Platform automation

Data governance

Tools

Databricks

AWS

Job description

Barclays in London is seeking a Data Engineer to build and operate production-grade data pipelines on Databricks and AWS, delivering scalable data products for a standalone payments platform.

You will collaborate with data scientists, apply Unity Catalog governance, and drive platform automation with Terraform and GitHub Actions, in a hybrid work pattern with three days in the office. Based in London, you will join a growing team at Barclays' offices in central locations.