Microsoft Fabric Engineer

Watershed Consulting; Pretoria; Vor Ort; ZAR 900.000 - 1.200.000; Vollzeit

Zusammenfassung

Watershed Consulting in Pretoria is seeking a Microsoft Fabric Engineer with hands-on experience designing, developing, and supporting modern data and analytics solutions on the Fabric platform.

You will build scalable data pipelines, implement Lakehouse architectures, develop semantic models, and enable BI using Power BI, PySpark, and CI/CD with Azure DevOps. Strong focus on performance, governance, and security across cloud data platforms.

Qualifikationen

• Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or related discipline.
• 8–10 years of experience in data engineering or analytics with Microsoft Fabric exposure.
• Proficiency in PySpark, Spark SQL, SQL, Python, and building semantic models for Power BI.

Aufgaben

• Design, develop, and support data solutions on Microsoft Fabric platform.
• Build and optimize data ingestion, transformation, and Lakehouse pipelines.
• Create reusable frameworks and automation for ETL/ELT processes.
• Ensure data quality, lineage, governance, and security controls.
• Configure Fabric workspaces, notebooks, and data pipelines; use PySpark and Spark SQL.
• Develop semantic models and Power BI datasets; integrate sources and support governance.
• Implement CI/CD using Azure DevOps and Git; enable deployment automation and monitoring.
• Collaborate with architects, analysts, data scientists, and reporting teams.

Kenntnisse

Microsoft Fabric

PySpark

SQL

Power BI

Azure DevOps

Data Modeling

Data Pipelines

Ausbildung

Bachelor's or Master's in CS/IT/Engineering

Tools

Git

Azure DevOps

Jobbeschreibung

Job Title

Microsoft Fabric Engineer

Description

We are looking for a skilled Microsoft Fabric Engineer with hands‑on experience in designing, developing, and supporting modern data and analytics solutions on the Microsoft Fabric platform. The candidate will design scalable data pipelines, implement Lakehouse architectures, develop semantic models, and enable business intelligence solutions using Microsoft Fabric and Power BI. The role requires strong data engineering expertise, cloud analytics experience, and a focus on performance, reliability, and governance.

Responsibilities

• Develop and maintain data solutions using Microsoft Fabric components including OneLake, Lakehouse, Data Pipelines, Notebooks, Data Warehouse, and Semantic Models.
• Build and optimise data ingestion, transformation, and processing workflows from multiple source systems and implement Medallion Architecture (Bronze, Silver, Gold).
• Create reusable engineering frameworks, templates, and automation for ETL/ELT processes supporting reporting, analytics, and AI use cases.
• Ensure data quality, lineage, and metadata standards across solutions and implement security controls and role‑based access.
• Configure and manage Fabric workspaces, Lakehouses, Warehouses, notebooks, and data pipelines; develop notebooks using PySpark and Spark SQL.
• Build and maintain semantic models and Power BI datasets, integrate on‑premises and cloud data sources, and support governance requirements.
• Implement CI/CD using Azure DevOps and Git; support deployment automation, monitoring, troubleshooting, and production support.
• Collaborate with architects, analysts, data scientists, and reporting teams to translate requirements, provide estimates, and promote Fabric best practices.

Qualifications

• Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or related discipline.
• 8 to 10 years of experience in data engineering or analytics with demonstrated experience on Microsoft Fabric and cloud data platforms.
• Proven experience with PySpark, Spark SQL, SQL, Python, and building semantic models and Power BI datasets.
• Experience with Azure DevOps, Git, CI/CD, DevOps practices, and deployment automation.
• Strong understanding of Medallion Architecture, data modeling, governance, metadata management, and security controls.
• Experience in performance tuning, troubleshooting data pipelines, and optimizing cost and capacity.
• Preferred: Microsoft Fabric Data Engineer or Azure Data Engineer certifications and experience in large enterprise domains such as BFSI or Retail.

Skills

• Microsoft Fabric
• OneLake
• Lakehouse
• Data Pipelines
• Notebooks
• Data Warehouse
• Semantic Models
• Power BI
• ETL/ELT
• Data Integration
• Data Modeling
• PySpark
• Spark SQL
• SQL
• Python
• Medallion Architecture
• Azure DevOps
• Git
• CI/CD
• Data Governance
• Metadata Management
• Role‑based access control
• Performance Tuning
• Azure Data Services
• Cloud‑native data platforms
• Business Intelligence
• Data Migration
• Structured Data
• Semi‑structured Data
• Unstructured Data
• Troubleshooting
• Automation
• Release Management
• Monitoring
• Data Lineage
• Security Controls
• Data Quality