Senior Data Engineer, Fabric Migration & Data Pipelines

Flash; South Africa; On-site; ZAR 900,000 - 1,300,000; Full time

Job summary

Flash, a Pepkor brand, seeks a Senior Data Engineer to build robust data pipelines from millions of daily transactions and migrate SQL Server workloads to Fabric. You will design scalable data platforms, enforce governance, ensure data quality, and collaborate with analysts, engineers, and business stakeholders.

You will own migration assessments, cutover planning, and decommissioning while maintaining legacy systems and controlling Fabric costs.

Qualifications

• Extensive experience building robust data pipelines from large transactional sources.
• Proficient in migrating SQL Server workloads to Fabric with minimal downtime.
• Strong understanding of data governance, quality, and security standards.

Responsibilities

• Own the migration of SQL Server workstreams to Microsoft Fabric, from assessment through cutover and decommissioning.
• Contribute to data architecture and platform design decisions for the Fabric estate.
• Design, develop, and maintain scalable data pipelines.
• Develop and maintain data models for analytics and reporting.
• Ensure data quality, integrity, and reliability across platforms.
• Monitor and troubleshoot data platform performance issues.
• Implement data governance, security, and compliance standards.
• Assess existing SQL Server estate and sequence the migration by risk and value.
• Rebuild SSIS packages as Fabric-native pipelines or Dataflows Gen2.
• Assist in implementing Master Data Management across the estate.
• Refactor T-SQL and stored procedures for Fabric Warehouse compatibility.
• Run parallel validation between legacy and Fabric outputs and plan zero-downtime cutovers.
• Maintain the legacy SQL Server platform during transition and decommission migrated components.
• Manage Fabric capacity consumption and platform cost.

Skills

Data pipelines

SQL Server

Microsoft Fabric

SSIS

Data modelling

Data governance

Data quality

Performance tuning

Master Data Management

T-SQL

Tools

SQL Server

SSIS

Fabric

Dataflows Gen2

Job description

Flash, a Pepkor brand, seeks a Senior Data Engineer to build robust data pipelines from millions of daily transactions and migrate SQL Server workloads to Fabric. You will design scalable data platforms, enforce governance, ensure data quality, and collaborate with analysts, engineers, and business stakeholders.

You will own migration assessments, cutover planning, and decommissioning while maintaining legacy systems and controlling Fabric costs.