Senior Databricks Data Platform Engineer - AI & Analytics

TD Bank Group; Belfast City District; Hybrid; GBP 70,000 - 120,000; Full time

Job summary

TD Securities in Belfast is hiring a Senior Data Engineer to help build and evolve the strategic Research data platform using Databricks. You will develop scalable data pipelines, governed data products, and foundational capabilities to support analytics, BI reporting, and AI initiatives.

You will work within a global Research Technology team, bridging between business stakeholders and technology teams to drive delivery, platform adoption, and end-to-end execution.

Qualifications

• 10+ years in data engineering or related enterprise technology roles.
• Hands-on experience with Databricks, Spark/PySpark, Python, and SQL.
• Experience designing scalable data pipelines and lakehouse solutions.
• Familiarity with Unity Catalog and data governance concepts.
• Proven ability to deliver enterprise-grade data platforms with CI/CD.
• Strong analytical, problem-solving and communication skills.

Responsibilities

• Contribute to Belfast-based data engineering efforts for global Research data platforms.
• Design, develop, and maintain scalable data pipelines using Python, SQL and Spark.
• Create curated, governed data products for analytics, dashboards and AI use cases.
• Support data ingestion, transformation across diverse data sources.
• Contribute to governance structures, lineage, access control and cataloging.
• Implement data quality, monitoring, and operational controls for production workloads.
• Support CI/CD, automation, and environment management for Databricks/Azure workloads.
• Collaborate with global engineering teams and stakeholders to translate requirements.
• Coordinate with Cognizant resources in India to align delivery across time zones.

Skills

Python

SQL

Data pipelines

Data governance

Communication

Delivery leadership

Tools

Databricks

Spark / PySpark

Azure

Delta Lake

Unity Catalog

Job description

TD Securities in Belfast is hiring a Senior Data Engineer to help build and evolve the strategic Research data platform using Databricks. You will develop scalable data pipelines, governed data products, and foundational capabilities to support analytics, BI reporting, and AI initiatives.

You will work within a global Research Technology team, bridging between business stakeholders and technology teams to drive delivery, platform adoption, and end-to-end execution.