Senior Data Engineer

TD; Belfast City District; On-site; GBP 70,000 - 110,000; Full time

Job summary

TD Securities in Belfast seeks a Senior Data Engineer to build and evolve a strategic Research data platform in Databricks. You will design scalable data pipelines, governed data products, and enable analytics, BI, and AI initiatives with a global delivery model.

Bring 10+ years in data engineering, strong Databricks and Python skills, and experience with Unity Catalog, CI/CD, and cloud data patterns. This on-site role collaborates across teams in Belfast, London, and India.

Qualifications

• 10+ years of experience in data engineering or related roles.
• Hands-on with Databricks, Spark/PySpark, Python and SQL.
• Experience designing scalable data pipelines and lakehouse solutions.
• Knowledge of Unity Catalog and data governance patterns.
• Experience with CI/CD, monitoring, and data quality controls.

Responsibilities

• Build and evolve the research data platform in Databricks from Belfast.
• Develop scalable data pipelines and governed data products.
• Collaborate with global teams to translate requirements into data solutions.
• Support CI/CD, automation, and environment management for Azure workloads.
• Coordinate with India-based resources to align delivery across time zones.

Skills

Databricks

Spark / PySpark

Python

SQL

Delta Lake

Azure

ADLS

Unity Catalog

CI/CD

Data quality

Data governance

Platform delivery

Communication

Tools

Databricks tools

Azure Data services

Job description

Work Location :Belfast, United KingdomHours:35Line of Business:Technology SolutionsPay Details:We’re committed to providing fair and equitable compensation to all our colleagues. As a candidate, we encourage you to have an open dialogue with a member of our HR Team and ask compensation related questions, including pay details for this role.Job Description:The TDS Research Technology team is responsible for delivering the data, analytics, and AI platforms that support Research business capabilities globally. From Belfast, this role will help build the strategic Research data platform leveraging Databricks, enabling reusable data products, modern analytics, and future AI solutions across the organization.Role DescriptionWe are seeking a Senior Data Engineer to help build and evolve the strategic Research data platform in Databricks. Working as part of a global Research Technology team, this role will focus on developing scalable data pipelines, governed data products, and foundational capabilities that support analytics, BI reporting, and AI initiatives.The successful candidate will bring a strong combination of hands-on engineering expertise and delivery leadership, acting as a key liaison between global business stakeholders and technology teams to drive successful execution and platform adoption.Role ResponsibilitiesWork as part of a Belfast-based data engineering team contributing to globally used Research data platforms, products, and services.Build the foundational Research data platform that will serve as a strategic data and AI enabler for the Research business.Design, develop, and maintain scalable data pipelines using Python, SQL, Spark, Databricks, Azure, and related cloud data technologies.Create curated, reusable, and governed data products that can be consumed by Research applications, dashboards, reporting tools, and AI-enabled solutions.Support data ingestion and transformation patterns across structured, semi-structured, and unstructured data sources where required.Contribute to data domain, table, object, field, and metadata structures that align with Unity Catalog and broader data governance patterns.Implement data quality, reconciliation, lineage, monitoring, audit, and operational controls required for production-grade data platforms.Support CI/CD, automation, deployment, and environment management practices for Databricks and Azure-based data workloads.Partner closely with global engineering colleagues, business stakeholders, platform teams, and data consumers to translate requirements into scalable data solutions.Act as a coordination bridge with Cognizant resources in India, using the Belfast time zone overlap to support delivery alignment, issue resolution, and execution follow-through.Communicate effectively, contribute to design discussions and demos, and support a collaborative global delivery model.A Successful Candidate Will Possess10+ years of experience in data engineering, data platform delivery, software engineering, or related enterprise technology roles.Strong hands-on experience with Databricks, Spark / PySpark, Python, SQL, Delta Lake, Azure, ADLS, and cloud-based data engineering patterns.Experience designing scalable data pipelines, data products, and lakehouse solutions using modern cloud data platform patterns.Experience with Unity Catalog or similar governance capabilities, including data discovery, access control, lineage, ownership, and catalog structures.Experience delivering enterprise-grade data platforms including CI/CD, monitoring, data quality, operational controls, and support processes.Strong analytical and problem-solving skills, with the ability to work through complex data, platform, and integration challenges.Strong communication skills with the ability to work effectively across local, global, and offshore teams.Ability to coordinate with India-based delivery resources and help bridge time zone, requirement, and execution gaps.Exposure to AI-ready data platform concepts, including metadata enrichment, document/data automation, unstructured data processing, RAG patterns, or AI/ML enablement would be beneficial.Knowledge of Research, Capital Markets, Global Markets, client analytics, readership, CRM, revenue, or market data domains would be beneficial.Why This Role in BelfastThis position offers the opportunity to be part of a strategically important Research Technology team from Belfast while contributing directly to the build-out of a modern, governed, and AI-ready data platform. The role combines hands-on data engineering, platform modernization, global collaboration, and delivery coordination across Toronto, London, New York, Belfast, and India.It is ideal for a senior data engineer who wants to help establish foundational data capabilities, support strategic AI and analytics initiatives, and play a visible role in shaping the future Research data platform.Who We AreTD Securities is one of the world's leading global financial institutions and is the fifth largest bank in North America by branches/stores. Every day, we strive to make every interaction, product, and experience remarkably human and refreshingly simple for over 27 million households and businesses in Canada, the United States and around the world. More than 95,000 TD colleagues bring their skills, talent, and creativity to foster deeper relationships, ensure disciplined execution, and build a simpler, faster banking experience. TD is deeply committed to being a leader in client experience, that is why we believe that all colleagues, no matter where they work, are client facing. Together, we are reimagining what banking can be for our clients, colleagues and communities.Our Total Rewards PackageOur Total Rewards package reflects the investment we make in our colleagues to help them, and their families achieve their well-being goals. Total Rewards at TD includes a base salary and several other key plans such as health and well-being benefits, including medical coverage, paid time off, career development, and reward and recognition programs.Additional Information:We’re delighted that you’re considering building a career with TD. Through regular development conversations, training programs, and a competitive benefits plan, we’re committed to providing the support our colleagues need to thrive both at work and at home.Colleague DevelopmentIf you’re interested in a specific career path or are looking to build certain skills, we want to help you succeed. You’ll have regular career, development, and performance conversations with your manager, as well as access to an online learning platform and a variety of mentoring programs to help you unlock future opportunities.If you’re passionate about helping clients and building deep, lasting relationships, TD offers diverse career paths where you can grow your expertise and make a meaningful impact.We're committed to your success and foster a respectful workplace where diverse perspectives are valued, everyone has fair opportunities to grow, and you can unlock your full potential to achieve your career goals. Here at TD, we hire and develop the best.Training & OnboardingWe will provide training and onboarding sessions to ensure that you’ve got everything you need to succeed in your new role.Interview ProcessWe’ll reach out to candidates of interest to schedule an interview. We do our best to communicate outcomes to all applicants by email or phone call.AccommodationIf you require an accommodation for the recruitment / interview process (including alternate formats of materials, or accessible meeting rooms or other accommodation), please let us know and we will work with you to meet your needs.