Senior Data Engineer

Sharp and Carter; City of Melbourne; On-site; AUD 140,000 - 190,000; Full time

Job summary

Sharp and Carter is seeking a Senior Data Engineer to advance the client’s Data Strategy by developing and managing a Microsoft Fabric data platform. You will serve as the technical SME for Fabric, independently designing and maintaining secure end-to-end data solutions from source connectivity to semantic models for reporting and analytics.

The role requires hands-on experience with Fabric components such as Data Factory pipelines, Copy Job, Dataflow Gen2, Notebooks, Lakehouse and Warehouse,

Qualifications

• Hands-on experience delivering production data solutions using Microsoft Fabric.
• Experience end-to-end data solutions: connectivity, ingestion, transformation, storage and orchestration.
• Strong SQL and Python/PySpark for data engineering tasks.
• Experience developing Power BI semantic models.

Responsibilities

• Act as the Microsoft Fabric SME and provide architectural and implementation guidance.
• Build secure connectivity between Fabric and source systems.
• Design and manage data ingestion and integration with Fabric.
• Develop data pipelines, transformations, Lakehouse and Warehouse solutions.
• Create trusted data models and Power BI semantic models.
• Oversee end-to-end data engineering lifecycle: monitoring, troubleshooting, deployment.

Skills

Microsoft Fabric

Data engineering

SQL

Python/PySpark

Power BI semantic models

Data Factory pipelines

Lakehouse

Data modelling

Tools

Notebooks

Job description

We are seeking a Senior Data Engineer to support our client’s Data Strategy by developing and managing its Microsoft Fabric data platform. You will act as the technical SME for Microsoft Fabric and independently design, build and maintain secure end to end data solutions from source connectivity and ingestion through transformation, storage and semantic models for reporting/analytics. The core responsibilities are:

• Act as the Microsoft Fabric technical SME, providing technical leadership around architecture, tools and implementation.
• Build secure connectivity between Microsoft Fabric and source systems.
• Design/manage data ingestion and integration using Fabric.
• Develop data pipelines, transformations, Lakehouse and Warehouse solutions.
• Build trusted data models and Power BI semantic models.
• Own the end-to-end data engineering lifecycle: monitoring, troubleshooting, optimisation and deployment.
• Establish development, security, version control and CI/CD practices.
• Work directly with business and technical stakeholders to turn requirements into secure, scalable solutions and produce technical documentation.

To be considered, you must demonstrate the following:

• Demonstrated hands-on experience designing and delivering production solutions using Microsoft Fabric, with ability to operate independently from commencement.
• Demonstrated experience delivering end-to-end data solutions, including secure source connectivity, ingestion, transformation, storage and orchestration.
• Strong practical experience selecting and using appropriate Microsoft Fabric capabilities, including Data Factory pipelines, Copy Job, Dataflow Gen2, Notebooks, Lakehouse and Warehouse.
• Strong SQL skills and practical experience using Python/PySpark for data engineering and transformation workloads.
• Strong data modelling experience including development of PowerBI semantic models