Senior Data Engineer - Databricks & AI Platform

TD; Belfast City District; On-site; GBP 70,000 - 110,000; Full time

Job summary

TD Securities in Belfast seeks a Senior Data Engineer to build and evolve a strategic Research data platform in Databricks. You will design scalable data pipelines, governed data products, and enable analytics, BI, and AI initiatives with a global delivery model.

Bring 10+ years in data engineering, strong Databricks and Python skills, and experience with Unity Catalog, CI/CD, and cloud data patterns. This on-site role collaborates across teams in Belfast, London, and India.

Qualifications

• 10+ years of experience in data engineering or related roles.
• Hands-on with Databricks, Spark/PySpark, Python and SQL.
• Experience designing scalable data pipelines and lakehouse solutions.
• Knowledge of Unity Catalog and data governance patterns.
• Experience with CI/CD, monitoring, and data quality controls.

Responsibilities

• Build and evolve the research data platform in Databricks from Belfast.
• Develop scalable data pipelines and governed data products.
• Collaborate with global teams to translate requirements into data solutions.
• Support CI/CD, automation, and environment management for Azure workloads.
• Coordinate with India-based resources to align delivery across time zones.

Skills

Databricks

Spark / PySpark

Python

SQL

Delta Lake

Azure

ADLS

Unity Catalog

CI/CD

Data quality

Data governance

Platform delivery

Communication

Tools

Databricks tools

Azure Data services

Job description

TD Securities in Belfast seeks a Senior Data Engineer to build and evolve a strategic Research data platform in Databricks. You will design scalable data pipelines, governed data products, and enable analytics, BI, and AI initiatives with a global delivery model.

Bring 10+ years in data engineering, strong Databricks and Python skills, and experience with Unity Catalog, CI/CD, and cloud data patterns. This on-site role collaborates across teams in Belfast, London, and India.