Senior Data Engineer

Flash; South Africa; On-site; ZAR 900,000 - 1,300,000; Full time

Job summary

Flash, a Pepkor brand, seeks a Senior Data Engineer to build robust data pipelines from millions of daily transactions and migrate SQL Server workloads to Fabric. You will design scalable data platforms, enforce governance, ensure data quality, and collaborate with analysts, engineers, and business stakeholders.

You will own migration assessments, cutover planning, and decommissioning while maintaining legacy systems and controlling Fabric costs.

Qualifications

• Extensive experience building robust data pipelines from large transactional sources.
• Proficient in migrating SQL Server workloads to Fabric with minimal downtime.
• Strong understanding of data governance, quality, and security standards.

Responsibilities

• Own the migration of SQL Server workstreams to Microsoft Fabric, from assessment through cutover and decommissioning.
• Contribute to data architecture and platform design decisions for the Fabric estate.
• Design, develop, and maintain scalable data pipelines.
• Develop and maintain data models for analytics and reporting.
• Ensure data quality, integrity, and reliability across platforms.
• Monitor and troubleshoot data platform performance issues.
• Implement data governance, security, and compliance standards.
• Assess existing SQL Server estate and sequence the migration by risk and value.
• Rebuild SSIS packages as Fabric-native pipelines or Dataflows Gen2.
• Assist in implementing Master Data Management across the estate.
• Refactor T-SQL and stored procedures for Fabric Warehouse compatibility.
• Run parallel validation between legacy and Fabric outputs and plan zero-downtime cutovers.
• Maintain the legacy SQL Server platform during transition and decommission migrated components.
• Manage Fabric capacity consumption and platform cost.

Skills

Data pipelines

SQL Server

Microsoft Fabric

SSIS

Data modelling

Data governance

Data quality

Performance tuning

Master Data Management

T-SQL

Tools

SQL Server

SSIS

Fabric

Dataflows Gen2

Job description

Flash is a well-established brand and part of Pepkor, with a global strategy and a clear purpose: making people’s lives easier.

We use frontier technology to create opportunities and build products and services that make a real difference in people’s everyday lives.

Our three values are the heartbeat of our business:

• We are all in
• We have each other’s backs
• We are brave

They shape how we work, how we show up for one another and the kind of culture we’re building. A place where people can do meaningful work, feel supported to do their best and have the freedom to make an impact.

If you’re excited by meaningful problems, smart people and building brands and products that improve everyday lives, we’d love to meet you.

Why this role matters

As our Senior Data Engineer, you’ll be responsible for creating robust data pipelines from millions of transactions a day, integrating data from multiple sources, ensuring data quality and governance, and optimising data platforms for performance and scalability.

This role plays a key part in enabling data-driven decisions by delivering trusted, accessible, and well-structured data to business stakeholders, analysts, and engineering teams

What you’ll own

• Own the migration of assigned workstreams from SQL Server to Microsoft Fabric, from assessment through cutover and decommissioning.
• Contribute to data architecture and platform design decisions for the target Fabric estate.
• Design, develop, and maintain scalable data pipelines.
• Develop and maintain data models for analytics and reporting.
• Ensure data quality, integrity, and reliability across platforms.
• Monitor and troubleshoot data platform performance issues.
• Implement data governance, security, and compliance standards.
• Assess and inventory the existing SQL Server estate — databases, SSIS packages, stored procedures, SQL Agent jobs, downstream report dependencies — and sequence the migration by risk and business value.
• Rebuild SSIS packages as Fabric-native pipelines, notebooks, or Dataflows Gen2.
• Assist in implementing Master Data Management across the estate.
• Refactor T-SQL and stored procedures for Fabric Warehouse compatibility, resolving unsupported constructs.
• Run parallel validation and reconciliation between legacy and Fabric outputs, and plan zero-downtime cutovers.
• Maintain and support the legacy SQL Server platform through the transition period, then decommission migrated components.
• Manage Fabric capacity consumption and platform cost.