Senior Databricks Data Engineer: Lead Platform Delivery

ISx4 Group; Belfast City District; Hybrid; GBP 70,000 - 100,000; Full time

Job summary

ISx4 Group seeks a Senior Databricks Data Engineer to lead delivery of data engineering workstreams within large-scale data platforms and migration programmes. You will combine hands-on expertise with consulting leadership to design, deliver and operate modern data platforms while collaborating with client stakeholders.

You will shape architecture decisions, mentor engineers and drive delivery across complex engagements, focusing on governance, security and performance optimisations in

Qualifications

• Senior data engineer with 7+ years in data engineering or data platform development.
• Proven leadership of engineering teams or workstreams and stakeholder engagement.
• Experience designing enterprise-scale data pipelines and lakehouse architectures.

Responsibilities

• Lead design and implementation of enterprise-scale data pipelines and lakehouse architectures.
• Provide technical leadership across Databricks, Spark and cloud data platforms.
• Drive delivery of data engineering workstreams within Agile programmes.
• Engage with client stakeholders to translate business objectives into technical solutions.
• Mentor engineers and establish engineering best practices.
• Lead architecture discussions with architects and platform teams.
• Oversee performance optimisation and platform reliability.
• Support data migration strategy and execution.
• Ensure governance, security and compliance standards are met.
• Produce architecture documentation, design artefacts and delivery roadmaps.

Tools

Databricks

Spark

Unity Catalog

Delta Lake

Hadoop

REST APIs

Kafka

CI/CD

Python

MS SQL Server

Job description

ISx4 Group seeks a Senior Databricks Data Engineer to lead delivery of data engineering workstreams within large-scale data platforms and migration programmes. You will combine hands-on expertise with consulting leadership to design, deliver and operate modern data platforms while collaborating with client stakeholders.

You will shape architecture decisions, mentor engineers and drive delivery across complex engagements, focusing on governance, security and performance optimisations in