Senior Data Engineer

ISx4 Group; Belfast City District; Hybrid; GBP 70,000 - 100,000; Full time

Job summary

ISx4 Group in the United Kingdom is seeking a Senior Data Engineer to lead data engineering workstreams within large-scale data platform and migration programmes. You will design, deliver and operate modern data platforms, mentor engineers and shape architecture decisions.

You will drive pipelines, lakehouse architectures, and data warehouse solutions while engaging with client stakeholders and leading technical delivery across complex engagements.

Qualifications

• 7+ years in data engineering or data platform development.
• Strong experience with modern cloud data platforms and Spark.
• Experience with data cataloguing, governance tooling and open table formats (Delta Lake, Iceberg) and streaming architectures.
• Advanced Python and Microsoft SQL Server development.
• Proven experience leading engineering teams or workstreams.
• Strong stakeholder engagement and consulting skills.
• Familiarity with Hadoop and CI/CD practices.
• REST APIs and Kafka experience.

Responsibilities

• Lead design and implementation of enterprise-scale data pipelines, lakehouse and data warehouse architectures.
• Provide technical leadership across cloud data platforms and distributed processing frameworks.
• Drive delivery of data engineering workstreams within Agile programmes.
• Engage with client stakeholders to translate business objectives into technical solutions.
• Mentor engineers and establish engineering best practices.
• Lead architecture and design discussions with architects and platform teams.
• Oversee performance optimisation and platform reliability.
• Support data migration strategy and execution.
• Ensure governance, security and compliance standards are met.
• Produce architecture documentation, design artefacts and delivery roadmaps.

Tools

Spark

Delta Lake

Iceberg

Kafka

REST APIs

CI/CD

Hadoop

Databricks

Job description

Job Role

We are seeking a Senior Data Engineer to lead delivery of data engineering workstreams within large-scale data platform and migration programmes. This role combines hands-on technical expertise with consulting leadership, ensuring the successful design, delivery and operation of modern data platforms while working closely with client stakeholders. You will play a key role in shaping architecture decisions, mentoring engineers and driving delivery across complex engagements.

Key Responsibilities

• Lead design and implementation of enterprise-scale data pipelines, lakehouse and data warehouse architectures
• Provide technical leadership across modern cloud data platforms and distributed processing frameworks
• Drive delivery of data engineering workstreams within Agile programmes
• Engage with client stakeholders to translate business objectives into technical solutions
• Mentor engineers and establish engineering best practices
• Lead architecture and design discussions with architects and platform teams
• Oversee performance optimisation and platform reliability
• Support data migration strategy and execution
• Ensure governance, security and compliance standards are met
• Produce architecture documentation, design artefacts and delivery roadmaps

Key Requirements

• 7+ yearsâ experience in data engineering or data platform development
• Strong experience with modern cloud data platforms, Spark and distributed data processing
• Experience with data cataloguing and governance tooling, open table formats (e.g. Delta Lake, Iceberg) and streaming architectures
• Advanced Python and Microsoft SQL Server development
• Proven experience leading engineering teams or workstreams
• Strong stakeholder engagement and consulting skills
• Working knowledge of Hadoop
• Experience with test-driven development and CI/CD
• REST APIs and Kafka experience

Nice to Have

• Hands on experience with databricks a distinct advantage
• Experience leading data platform migrations
• Experience managing delivery in large transformation programmes
• Experience delivering projects in regulated environments