Senior Data Engineering Manager

The Very Group; Parramatta; Hybrid; AUD 133,000 - 147,000; Full time

Job summary

NSW Department of Climate Change, Energy, the Environment and Water (DCCEEW) is seeking a Senior Data Engineer to shape its modern data environment. You will design, develop and support trusted data products used across climate, energy and water management.

You will collaborate with analysts, engineers and domain experts to turn diverse data sources into reliable, scalable solutions, building platform governance and automation to ensure data products remain available and secure.

Qualifications

• Extensive experience in data engineering including design, development and production support.

Responsibilities

• Build robust transformation processes in Fabric Notebooks using modular Python and PySpark code.
• Apply Medallion architectures to create well-structured lakehouses and warehouses.
• Develop data products that are reliable, observable and fit for purpose with strong data quality controls.
• Monitor pipeline performance and resolve issues before they affect downstream use.
• Collaborate with domain experts to translate data challenges into mesh-aligned solutions.
• Share knowledge through reusable notebooks, templates and engineering practices.
• Operate the enterprise data platform including monitoring, access management and incident resolution.
• Improve governance, controls, monitoring and automation for data products.

Skills

Python

PySpark

SQL

Medallion architecture

Delta Lake

Microsoft Fabric

Data quality practices

Agile teamwork

Notebooks

Data governance

Tools

Microsoft Fabric

Delta Lake

Job description

Job Description

Do you want your work to make a difference for NSW?

Working to protect the state’s environment and heritage.

• Help shape the future of data in one of Australia’s most critical sectors
• Two X Temporary full-time opportunity up to 30 June 2028, 35 hours/week
• Parramatta preferred, with hybrid working supported
• Salary relative to experience, and ranges from $ 133,348 - $ 146,945 + super and annual leave loading

Are you ready to help shape the future of data in one of Australia’s most critical sectors?

Join the NSW Department of Climate Change, Energy, the Environment and Water (DCCEEW) and be part of a team that’s driving innovation at scale, leveraging cutting-edge technology to deliver insights that matter for our environment, energy, and water resources.

About the Role

As a Senior Data Engineer , you will help shape the department’s modern data environment and build the foundations that enable better decisions across climate, energy, and water management.

You will design, develop, and support trusted data products used by teams across the department. Working with subject matter experts, analysts, and other engineers, you will turn complex and diverse data sources into reliable, scalable, and accessible products that support real-world outcomes.

This role will involve:

• BuildingrobusttransformationprocessesinFabricNotebooksusingmodular,reusable,andparameterisedPythonandPySparkcode.
• ApplyingMedallionarchitecturepatternstocreatewell-structured,governed,andhigh-performingLakehousesandWarehouses.
• Developingdataproductsthatarereliable,observable,andfitforpurpose,withstrongcontrolsforauditing,loadassurance,dataquality,anderrorhandling.
• Monitoringpipelineperformanceandresolvingissuesbeforetheyaffectdownstreamuse.
• Workingdirectlywithdomainexpertstounderstandtheirdatachallengesanddeliversolutionsalignedwithdatameshprinciples.
• Sharingyourknowledgethroughreusablenotebooks,templates,frameworks,andengineeringpracticesthathelpliftcapabilityacrosstheteam.
• Support and operate the department's enterprise data platform, including platform monitoring, operational support, access management, incident resolution, and the ongoing maintenance of secure and reliable data services.
• Implement and continuously improve platform governance, operational controls, monitoring, automation, and support processes to ensure data products remain available, secure, and fit for purpose.

You will have the opportunity to work on complex datasets, solve challenging data problems, and contribute to a growing enterprise data platform built on Microsoft Fabric.

About You

You are an experienced data engineer who enjoys turning complex data challenges into practical, reliable solutions. You are comfortable working across the full data engineering lifecycle—from ingestion and transformation through to performance optimisation, monitoring, and support.

You will bring:

• Extensiveexperienceinadataengineeringroleinvolvingthedesign,development,andsupportofproductiondatasolutions.
• PracticalexperiencewithMicrosoftFabric,includingLakehouses,Warehouses,DataPipeline,Mirroring,andNotebooks.
• StrongprogrammingskillsinPython,PySpark,andSQL.
• KnowledgeofDeltaLake,schemaevolution,Medallionarchitecture,anddataqualitypracties.
• Experienceworkinginagileteamsandcollaboratingwithtechnicalandnon-technicalstakeholders.
• Theabilitytounderstandbusinessanddomainrequirementsandtranslatethemintohigh-qualitydataproducts.
• Aproactiveapproachtoproblem solving,continuousimprovement,andknowledgesharing.

You will be someone who can work independently, contribute confidently to technical discussions, and help establish engineering standards as the department continues to grow its Microsoft Fabric capability.

DCCEEW conserves and protects the state’s natural environment. It manages the NSW national park estate, including its rich and diverse biodiversity and Aboriginal cultural heritage for future generations.

DCCEEW also ensures sustainable management of water resources across the state, to support the environment, communities and industry.

We acknowledge the ongoing custodial responsibilities of the Aboriginal peoples of NSW to care for Country and water and are committed to establishing meaningful partnerships with Aboriginal peoples in the management of the environment.

Applications close Wednesday, 28 Oct 2026 at 11:55PM.

Should you require further information about the role, please contact Damon White, Principal Data Engineer via .

Please also note, to be eligible for an ongoing role in the NSW Public Sector you need to be an Australian Citizen or Permanent Resident. For temporary and casual roles, you need to hold a valid visa giving you permission to work in Australia as required by the role.

A recruitment pool may be created for ongoing and temporary opportunities of the same role or role type that may become available over the next 18 months. Our goal is to build a workforce that not only represents but also understands and serves the diverse communities of New South Wales. We are committed to making our state a vibrant and inclusive place to live, work, and thrive for everyone. Our workforce represents people of all ages and genders, Aboriginal and Torres Strait Islander people, people with disabilities, the LGBTQI+ community, and people from diverse ethnic and cultural backgrounds.