Azure Data Engineer — Lakehouse & Governance

Victoria University of Wellington; Wellington; On-site; NZD 90,000 - 130,000; Full time

Job summary

Victoria University of Wellington is seeking a Data Engineer to join Te Tai Matihiko - Digital Solutions on a fixed-term basis. You’ll contribute to building our enterprise data and analytics platform as we progressively replace our end-of-life data warehouse with an Azure-based Data Lakehouse.

You’ll help deliver trusted, quality data and contribute to the enterprise data catalogue through metadata, data definitions and lineage information, making institutional data easier to discover,

Qualifications

• Experience designing, building, deploying and maintaining production data solutions.
• Strong SQL skills and experience with Python and PySpark are highly advantageous.
• Sound knowledge of cloud data platforms, data integration and transformation (ETL/ELT), data modelling and data-quality controls.
• Understanding of metadata, lineage and data-governance principles, with experience implementing data catalogue and related governance-support capabilities advantageous.
• Strong analytical, problem-solving and communication skills, with the ability to work effectively with technical and non-technical colleagues.

Responsibilities

• Contribute to the design and build of our new Azure-based Data, Reporting and Analytics platform.
• Develop reliable, reusable data pipelines, transformations, data models and governed data products.
• Contribute metadata, data definitions and lineage information to support the enterprise data catalogue and data governance.
• Apply validation, reconciliation, testing and monitoring practices to identify data-quality issues early and deliver trusted, production-ready data solutions.
• Collaborate with University teams including key stakeholders and our external delivery partner.

Skills

Strong SQL skills

Python

PySpark

Cloud data platforms

Data integration

Data modelling

Data-quality controls

Job description

Victoria University of Wellington is seeking a Data Engineer to join Te Tai Matihiko - Digital Solutions on a fixed-term basis. You’ll contribute to building our enterprise data and analytics platform as we progressively replace our end-of-life data warehouse with an Azure-based Data Lakehouse.

You’ll help deliver trusted, quality data and contribute to the enterprise data catalogue through metadata, data definitions and lineage information, making institutional data easier to discover,