Senior Data Engineer: Microsoft Fabric Platform Lead

APM; Perth; Sur place; AUD 150 000 - 190 000; Plein temps

Résumé du poste

APM is seeking a Senior Data Engineer to lead the design and optimisation of enterprise data platforms using Microsoft Fabric. You will drive governance, performance, security and cloud transformation across data teams.

You will mentor engineers, deliver Bronze-Silver-Gold data pipelines, leverage OneLake, Lakehouse, Data Factory and Semantic Models, and collaborate with analytics, security and infrastructure teams to realise reporting and AI initiatives.

Qualifications

• 7+ years of experience supporting enterprise data platforms and data infrastructure services.
• Hands-on experience delivering Microsoft Fabric implementations and transformation projects.
• Expertise in Microsoft Fabric, OneLake, Lakehouse and Warehouse architectures, Azure Data Factory, SQL Server and Azure SQL, Power BI and Semantic Models.
• Strong governance, security, encryption, auditing and compliance knowledge.
• Experience with performance tuning, backup/recovery, high availability and DR in cloud environments.
• Proven ability to engage stakeholders and translate technical concepts into business outcomes.

Responsabilités

• Design and optimise Microsoft Fabric solutions including OneLake, Lakehouses, Warehouses, Data Factory pipelines and Spark notebooks.
• Implement scalable Medallion Architecture across Bronze, Silver, Gold and Serving layers.
• Develop resilient batch and real-time data integration pipelines from apps, APIs and databases.
• Build data transformations using SQL, Python and PySpark.
• Deliver data platform migration, modernisation and reporting transformations.
• Drive data quality, governance, security and compliance across the data lifecycle.
• Lead performance tuning, monitoring, capacity management and disaster recovery planning.
• Provide technical leadership, mentoring and knowledge sharing across data teams.
• Troubleshoot production issues and drive continuous improvement.

Connaissances

Microsoft Fabric

OneLake

Lakehouse

Warehouse architectures

SQL

Python

PySpark

Power BI

Data governance

Security

Stakeholder engagement

Outils

Azure Data Factory

Azure SQL

SQL Server

Power BI

Spark notebooks

Description du poste

APM is seeking a Senior Data Engineer to lead the design and optimisation of enterprise data platforms using Microsoft Fabric. You will drive governance, performance, security and cloud transformation across data teams.

You will mentor engineers, deliver Bronze-Silver-Gold data pipelines, leverage OneLake, Lakehouse, Data Factory and Semantic Models, and collaborate with analytics, security and infrastructure teams to realise reporting and AI initiatives.