Senior Data Engineer: Scalable Pipelines & Fabric Migration

Flash Group; Wes-Kaap; On-site; ZAR 800,000 - 1,200,000; Full time

Benefits offered by this job

Catered lunch four days a week

Open coffee bar and snacks

Employee Assistance Programme

Corporate Social Investment events

Free on-site parking

Access to LinkedIn Learning

Social events throughout the year

Group risk benefits

Flash Club – extra leave days

Job summary

Flash Group in Western Cape is seeking a Senior Data Engineer to build robust data pipelines from millions of transactions daily and to migrate SQL Server workloads to Microsoft Fabric. You will champion data quality, governance, and scalable platform design while collaborating with analysts, stakeholders and engineering teams.

The role focuses on designing, implementing, and maintaining Fabric-native pipelines, data models and governance practices to empower data-driven decisions across the

Qualifications

• Bachelor’s degree in computer science, information systems or engineering.
• 5–8 years in data engineering, including hands‑on SQL Server (T‑SQL, SSIS, SQL Agent) in production.
• Demonstrable experience delivering a cloud data platform migration or greenfield Lakehouse/warehouse build.
• Microsoft Fabric experience highly advantageous or directly transferable experience on Azure Synapse or Databricks.

Responsibilities

• Own the migration of assigned workstreams from SQL Server to Microsoft Fabric, from assessment through cutover and decommissioning.
• Contribute to data architecture and platform design decisions for the target Fabric estate.
• Design, develop, and maintain scalable data pipelines.
• Develop and maintain data models for analytics and reporting.
• Ensure data quality, integrity, and reliability across platforms.
• Monitor and troubleshoot data platform performance issues.
• Implement data governance, security, and compliance standards.
• Rebuild SSIS packages as Fabric-native pipelines, notebooks, or Dataflows Gen2.
• Assist in implementing Master Data Management across the estate.
• Refactor T‑SQL and stored procedures for Fabric Warehouse compatibility, resolving unsupported constructs.
• Run parallel validation and reconciliation between legacy and Fabric outputs, and plan zero‑downtime cutovers.
• Maintain and support the legacy SQL Server platform through the transition period, then decommission migrated components.
• Manage Fabric capacity consumption and platform cost.

Skills

Analytical thinking

Stakeholder influence

Attention to detail

Strategic orientation

Adaptability

Problem solving

Education

Bachelor’s degree in computer science, information systems or engineering

Tools

Microsoft Fabric

Azure Synapse

Databricks

SSIS

SQL Server

T-SQL

SQL Agent

Job description

Flash Group in Western Cape is seeking a Senior Data Engineer to build robust data pipelines from millions of transactions daily and to migrate SQL Server workloads to Microsoft Fabric. You will champion data quality, governance, and scalable platform design while collaborating with analysts, stakeholders and engineering teams.

The role focuses on designing, implementing, and maintaining Fabric-native pipelines, data models and governance practices to empower data-driven decisions across the