Senior Data Engineer: Fabric Migration & Scalable Pipelines

Flash Group; Wes-Kaap; On-site; ZAR 900,000 - 1,300,000; Full time

Benefits offered by this job

Catered lunch four days a week

Open coffee bar and snacks

Employee Assistance Programme

Corporate Social Investment events

Free on-site parking

LinkedIn Learning access

Social events

Group risk benefits

Flash Club – extra leave

Job summary

Flash Group in Western Cape is seeking a Senior Data Engineer to build robust data pipelines from millions of daily transactions and lead the migration of SQL Server workloads to Microsoft Fabric. You will design scalable data platforms, ensure governance and data quality, and collaborate with analytics and engineering teams.

The role focuses on migrating legacy SQL Server assets, developing Fabric-native solutions, and optimizing for performance and cost in a fast-paced fintech environment.

Qualifications

• Bachelor's degree in computer science, Information Systems or Engineering.
• 5-8 years in data engineering, including hands-on SQL Server (T-SQL, SSIS, SQL Agent) in production.
• Demonstrable experience delivering a cloud data platform migration or greenfield Lakehouse/warehouse build.
• Microsoft Fabric experience highly advantageous or directly transferable experience on Azure Synapse or Databricks.

Responsibilities

• Own the migration of assigned workstreams from SQL Server to Microsoft Fabric, from assessment through cutover and decommissioning.
• Contribute to data architecture and platform design decisions for the target Fabric estate.
• Design, develop, and maintain scalable data pipelines.
• Develop and maintain data models for analytics and reporting.
• Ensure data quality, integrity, and reliability across platforms.
• Monitor and troubleshoot data platform performance issues.
• Implement data governance, security, and compliance standards.
• Assess and inventory the existing SQL Server estate and plan migration by risk and value.
• Rebuild SSIS packages as Fabric-native pipelines, notebooks, or Dataflows Gen2.

Skills

SQL Server

SSIS

SQL Agent

Azure Synapse

Databricks

Data migration

Data governance

Data quality

Education

Bachelor’s degree in computer science, Information Systems or Engineering

Tools

SQL Server

SSIS

Fabric

Job description

Flash Group in Western Cape is seeking a Senior Data Engineer to build robust data pipelines from millions of daily transactions and lead the migration of SQL Server workloads to Microsoft Fabric. You will design scalable data platforms, ensure governance and data quality, and collaborate with analytics and engineering teams.

The role focuses on migrating legacy SQL Server assets, developing Fabric-native solutions, and optimizing for performance and cost in a fast-paced fintech environment.