Senior Data Engineer / Engineering Lead

Pearson Carter Limited; Wellington; On-site; NZD 120,000 - 170,000; Part time

Job summary

Pearson Carter Limited is seeking a Senior Data Engineer / Engineering Lead to deliver production-ready data products within a Microsoft Fabric and Azure Lakehouse environment for a major public sector client in Wellington.

You will lead ingestion, ETL/ELT patterns, and governance, while hands-on building data pipelines and implementing Medallion Architecture across Fabric and OneLake.

Qualifications

• Hands-on data engineering in Microsoft Fabric environments.
• Experience implementing Medallion architecture across data platforms.
• Proficient in PySpark and Python for large-scale data processing.

Responsibilities

• Design and deliver production-grade data products.
• Implement Medallion Architecture across Fabric and OneLake.
• Build scalable pipelines using Fabric Dataflows Gen2, Pipelines and PySpark.
• Develop ingestion and ETL/ELT frameworks.
• Support data lineage, metadata, security, and governance through Purview.
• Validate Fabric capacity, workspace configuration, and platform readiness.

Skills

PySpark

Python

T-SQL

Delta Lake

Medallion Architecture

Dimensional Modelling

Tools

Microsoft Fabric

OneLake

Lakehouse

Dataflows Gen2

Pipelines

Purview

Job description

Senior Data Engineer / Engineering Lead Microsoft Fabric Public Sector

Pearson Carter are currently working with a major enterprise public sector organisation looking to strengthen its data engineering capability across a modern Microsoft Fabric environment.

They are seeking a Senior Data Engineer / Engineering Lead to deliver production-ready data products, lead ingestion and ETL/ELT patterns, and establish robust Medallion Architecture and governance practices across the platform.

This is a hands-on technical leadership role working across Microsoft Fabric, OneLake, Lakehouses, Data Warehouses, PySpark, Python, and Microsoft Purview.

Get in touch if you're looking for your next opportunity!

Responsibilities

• Design and deliver production-grade data products
• Implement Medallion Architecture across Fabric and OneLake
• Build scalable pipelines using Fabric Dataflows Gen2, Pipelines and PySpark
• Develop ingestion and ETL/ELT frameworks
• Support data lineage, metadata, security, and governance through Purview
• Validate Fabric capacity, workspace configuration, and platform readiness
• Work closely with architects and technical stakeholders

Experience

• Strong hands-on Microsoft Fabric experience
• OneLake, Lakehouse, Dataflows Gen2 and Fabric Pipelines
• Strong PySpark, Python, T-SQL and Delta Lake skills
• Experience with Medallion Architecture and dimensional modelling
• Microsoft Purview experience
• Experience with enterprise or public sector data environments
• Matillion experience is highly desirable

Location

Wellington

Engagement

Immediate part-time start, transitioning into full-time.

Applications are welcome from Senior Data Engineers and Engineering Leads with strong Microsoft Fabric and Azure Lakehouse experience.