Senior Data Engineer: Microsoft Fabric & Data Platform

APM; City of Melbourne; Sur place; AUD 120 000 - 160 000; Plein temps

Résumé du poste

APM is seeking a Senior Data Engineer to design, build and support enterprise data solutions within the Microsoft Fabric ecosystem. You will lead best-practice implementation across data engineering, governance, performance optimisation and operational support, driving large-scale data platform modernisation and cloud transformation initiatives.

You will collaborate with Architects, Cyber Security, Infrastructure and Analytics teams to deliver secure, scalable, governed data platforms and

Qualifications

• 7+ years' experience supporting enterprise data platforms and data infrastructure services
• Hands-on experience delivering Microsoft Fabric implementations and transformation projects
• Strong expertise across Microsoft Fabric, OneLake, Lakehouse and Warehouse architectures
• Proficiency in Azure Data Factory, SQL Server/Azure SQL, Power BI and Semantic Models
• Proficient in SQL, Python and PySpark
• Experience designing secure, scalable and governed cloud data platforms
• Knowledge of data governance, security, encryption, auditing and compliance
• Experience with performance tuning, backup and disaster recovery

Responsabilités

• Designing and optimising Microsoft Fabric solutions including OneLake, Lakehouses, Warehouses, Data Factory pipelines, Dataflows Gen2, Spark notebooks and Semantic Models
• Implementing scalable Medallion Architecture across Bronze, Silver, Gold and Serving data layers
• Developing resilient batch and near real-time data integration pipelines from enterprise applications, APIs, databases and cloud platforms
• Building complex data transformations using SQL, Python and PySpark
• Delivering data platform migration, modernisation and reporting transformation initiatives
• Driving data quality, governance, security and compliance across the data lifecycle
• Leading performance tuning, monitoring, optimisation and capacity management activities
• Designing and supporting backup, recovery, high-availability and disaster recovery solutions
• Providing technical leadership, mentoring and knowledge sharing across data teams
• Supporting production-critical environments through troubleshooting, root cause analysis and continuous improvement initiatives

Connaissances

Microsoft Fabric

OneLake

Lakehouse Architecture

Azure Data Factory

SQL Server / Azure SQL

Power BI & Semantic Models

Python & PySpark

Data Governance & Security

Enterprise Data Platform

7+ years experience

Description du poste

APM is seeking a Senior Data Engineer to design, build and support enterprise data solutions within the Microsoft Fabric ecosystem. You will lead best-practice implementation across data engineering, governance, performance optimisation and operational support, driving large-scale data platform modernisation and cloud transformation initiatives.

You will collaborate with Architects, Cyber Security, Infrastructure and Analytics teams to deliver secure, scalable, governed data platforms and