MS Fabric Data Architect & Lead Data Product Engineer

Pearson Carter; Wellington; On-site; NZD 150,000 - 210,000; Full time

Job summary

Pearson Carter is seeking an experienced Senior Data Engineer / Engineering Lead with deep expertise in the Microsoft Fabric ecosystem to deliver governed, production-ready data products for a critical public sector environment in Wellington, NZ.

You will lead end-to-end ingestion and ETL patterns, enforce Medallion Architecture standards, and ensure seamless integration with Microsoft Purview governance, OneLake, and Lakehouse components using PySpark, T-SQL, Python, and Delta Lake

Qualifications

• Experience with Microsoft Fabric platform (OneLake, Lakehouse, Dataflows Gen2, Pipelines, DirectLake/Semantic Models).
• Proficiency in PySpark, T-SQL, Python, and Delta Lake optimization.
• Experience with data governance and Purview integration.

Responsibilities

• Design, build, and deploy 1–2 production-grade data products within an MS Fabric platform.
• Implement Medallion Architecture across OneLake, Lakehouses, and Data Warehouses.
• Build scalable orchestration pipelines using MS Fabric Dataflows Gen2, Pipelines, PySpark/Notebooks, and Matillion.
• Collaborate on lineage tracking, security controls, and metadata capture with Purview.
• Participate in early-phase platform reviews to validate capacity and readiness.

Skills

MS Fabric Core

PySpark

Python

T-SQL

Delta Lake

Tools

Matillion

Microsoft Purview

Job description

Pearson Carter is seeking an experienced Senior Data Engineer / Engineering Lead with deep expertise in the Microsoft Fabric ecosystem to deliver governed, production-ready data products for a critical public sector environment in Wellington, NZ.

You will lead end-to-end ingestion and ETL patterns, enforce Medallion Architecture standards, and ensure seamless integration with Microsoft Purview governance, OneLake, and Lakehouse components using PySpark, T-SQL, Python, and Delta Lake