Microsoft Fabric Engineer

CareCone Group; Sydney; On-site; AUD 110,000 - 180,000; Full time

Job summary

CareCone Group in Sydney is seeking an experienced Microsoft Fabric Engineer to design, develop, and implement scalable data engineering solutions using Microsoft Fabric. You will build end-to-end data pipelines and Lakehouse architectures, perform data transformation, and align with modern cloud data platforms.

You will implement Medallion Architecture, work with Azure data services, and collaborate with data architects and stakeholders to deliver data solutions.

Qualifications

• Hands-on experience with Microsoft Fabric and its components.
• Strong Python, PySpark and SQL skills for data processing.
• Experience building ETL/ELT pipelines and data integration.
• Knowledge of Medallion Architecture and modern data engineering practices.

Responsibilities

• Design, develop, and maintain end-to-end data engineering solutions using Microsoft Fabric.
• Build and manage data pipelines using Fabric Data Factory and Dataflows Gen2.
• Implement Lakehouse and Data Warehouse solutions using Microsoft Fabric and OneLake.
• Develop data transformation and processing using Python, PySpark, and SQL.
• Implement Medallion Architecture (Bronze, Silver, Gold).
• Ingest, cleanse, transform, and integrate data from multiple sources.
• Optimize SQL queries and PySpark notebooks for large-scale processing.
• Work with Azure Data Lake Storage, Azure Data Factory, and other Azure services.
• Collaborate with data architects, analysts, and stakeholders; support CI/CD with Azure DevOps and Git.

Skills

Microsoft Fabric

Python

PySpark

SQL

Medallion Architecture

Azure

Tools

Azure Data Factory

OneLake

Azure DevOps

Notebooks

Azure Data Lake Storage

Job description

We are looking for an experienced Microsoft Fabric Engineer to design, develop, and implement scalable data engineering solutions using Microsoft Fabric. The ideal candidate should have strong hands-on experience in data pipelines, Lakehouse architecture, data transformation, and modern cloud-based data platforms.

Key Responsibilities

• Design, develop, and maintain end-to-end data engineering solutions using Microsoft Fabric.
• Build and manage data pipelines using Fabric Data Factory and Dataflows Gen2.
• Implement Lakehouse and Data Warehouse solutions using Microsoft Fabric and OneLake.
• Develop data transformation and processing solutions using Python, PySpark, and SQL.
• Implement Medallion Architecture (Bronze, Silver, and Gold layers).
• Perform data ingestion, cleansing, transformation, and integration from multiple sources.
• Develop and optimise SQL queries and PySpark notebooks for large-scale data processing.
• Work with Azure Data Lake Storage, Azure Data Factory, and other Azure data services.
• Collaborate with data architects, analysts, and business stakeholders to deliver data solutions.
• Support CI/CD, version control, and deployment processes using Azure DevOps and Git.

Required Skills & Experience

• Strong hands-on experience in Microsoft Fabric.
• Good knowledge of Fabric components such as OneLake, Lakehouse, Warehouse, Data Factory, and Notebooks.
• Strong programming skills in Python, PySpark, and SQL.
• Experience developing ETL/ELT pipelines and data integration solutions.
• Good understanding of Medallion Architecture and modern data engineering practices.
• Experience in data modelling, data warehousing, and dimensional modelling.
• Exposure to Azure Data Lake Storage and Azure Data Factory.
• Experience with Azure DevOps, Git, and CI/CD practices.