Senior Data Engineer: Data Transformation (Fabric)

APM; City of Brisbane; On-site; AUD 150,000 - 210,000; Full time

Job summary

APM is seeking a Senior Data Engineer to lead the design, development and optimisation of enterprise data platforms using the Microsoft Fabric ecosystem. You will drive data integration, governance and AI-ready analytics across the organisation.

You will mentor teams, implement Medallion architecture, ensure security and compliance, and partner with Architects, Security, Infrastructure and Analytics to deliver scalable data solutions.

Qualifications

• 7+ years of experience in supporting enterprise data platforms and data infrastructure services.
• Hands-on experience delivering Microsoft Fabric implementations and transformations.
• Strong expertise in Microsoft Fabric, OneLake, Lakehouse, and Warehouse architectures.
• Experience with Azure Data Factory, Microsoft SQL Server/Azure SQL, Power BI and semantic models.

Responsibilities

• Design and optimise Microsoft Fabric solutions including OneLake, Lakehouses, Warehouses, Data Factory pipelines, Dataflows Gen2, Spark notebooks and semantic models.
• Implement scalable Medallion Architecture across Bronze, Silver, Gold and Serving layers.
• Develop resilient batch and near real-time data integration pipelines from enterprise applications, APIs, databases and cloud platforms.
• Build complex data transformations using SQL, Python and PySpark.
• Deliver data platform migration, modernisation and reporting transformation initiatives.
• Drive data quality, governance, security and compliance across the data lifecycle.
• Lead performance tuning, monitoring, optimisation and capacity management activities.
• Design and support backup, recovery, high-availability and disaster recovery solutions.
• Provide technical leadership, mentoring and knowledge sharing across data teams.
• Support production-critical environments through troubleshooting and root cause analysis.

Skills

Microsoft Fabric

OneLake

Lakehouse

Data Factory

PySpark

Python

SQL

SQL Server

Azure SQL

Power BI

Semantic Models

Data governance

Performance tuning

Tools

Azure Data Factory

Microsoft SQL Server

Azure SQL

Job description

APM is seeking a Senior Data Engineer to lead the design, development and optimisation of enterprise data platforms using the Microsoft Fabric ecosystem. You will drive data integration, governance and AI-ready analytics across the organisation.

You will mentor teams, implement Medallion architecture, ensure security and compliance, and partner with Architects, Security, Infrastructure and Analytics to deliver scalable data solutions.