Lead Data Engineer

Data Engineer – Microsoft Fabric (Team Lead)

We are seeking a Data Engineer – Microsoft Fabric (Team Lead) to design, implement, and optimise data solutions while leading a growing data team. This is an exciting opportunity to work on cutting-edge data infrastructure, business intelligence, and analytics projects within a fast-paced, innovation-driven environment. If you have a passion for data engineering, Microsoft Fabric, and leading high-performing teams, we’d love to hear from you!

Role Overview

As a Data Engineer – Microsoft Fabric (Team Lead), you will be responsible for developing and maintaining scalable data pipelines and infrastructure within Microsoft Fabric. You will lead data warehouse architecture, oversee data ingestion and transformation, and ensure data quality, governance, and security best practices.

Additionally, you will build and lead a data team, initially managing an existing analyst while expanding the team as needed. Your role will involve working closely with stakeholders to translate business requirements into technical solutions and develop robust data models that drive key business insights.

Key Responsibilities

• Lead the design, development, and optimisation of scalable data pipelines and infrastructure within Microsoft Fabric.
• Architect and manage the data warehouse and lakehouse environments, ensuring efficient data ingestion, transformation, and integration.
• Implement ETL/ELT processes, data governance, and security protocols to maintain data integrity and compliance.
• Develop Power BI Semantic Models (datasets) and oversee deployment pipelines.
• Utilise Azure Data Services (Synapse, Data Factory, Databricks, SQL) to build robust data solutions.
• Lead CI/CD deployment processes using Azure DevOps and GitHub.
• Provide mentorship, training, and career development opportunities for team members.
• Stay up to date with emerging data engineering trends and Microsoft Fabric advancements.

Qualifications & Experience

Technical Skills

• 5+ years of experience in Azure Data Services (Synapse, Data Factory, Databricks, SQL).
• Proven experience with Microsoft Fabric Pipelines, Lakehouse, and Warehouse capabilities.
• Strong expertise in T-SQL (Stored Procedures & Functions) for data processing.
• Experience designing and implementing Star Schema-based data models.
• Proficiency in ETL/ELT processes, data modeling, and performance optimisation.
• Hands-on experience with PySpark and Spark SQL for data transformation.
• Strong knowledge of Power BI (Premium/Embedded experience is a plus).
• Familiarity with Azure DevOps and GitHub CI/CD pipelines for data deployments.

Leadership & Business Skills

• Proven experience leading and managing a data team, including hiring and mentoring.
• Ability to translate business requirements into technical data solutions.
• Strong communication and stakeholder engagement skills across business and technical teams.
• Experience in project management, agile methodologies, and process automation.
• Background in financial services, sales optimisation, or regulatory reporting (preferred).

Why Join?

• Leadership Role – Take ownership of strategic data initiatives and grow a high-performing team.
• Innovative Environment – Work with cutting-edge data technologies and analytics solutions.
• Career Growth – Professional development opportunities.
• Hybrid Work Flexibility – Work from Cape Town or Stellenbosch with a flexible hybrid schedule.

How to Apply

If you are a skilled Data Engineer with Microsoft Fabric expertise and a passion for leading teams and driving data intelligence, we’d love to hear from you!

If you are not contacted within 10 days of your application, please consider your application unsuccessful.