Senior Data Engineer

NSW Department of Climate Change, Energy, the Environment and Water; Sydney; Hybrid; AUD 133,000 - 147,000; Full time

Job summary

The NSW Department of Climate Change, Energy, the Environment and Water is seeking a Senior Data Engineer to shape the department’s modern data environment and build trusted data products for climate, energy and water management.

You will design, develop and operate pipelines, apply Medallion architecture, and work with Fabric, PySpark, Python, and SQL. Hybrid work with Parramatta preferred to support data-driven decision making.

Qualifications

• Extensive data engineering experience delivering production data solutions.
• Practical experience with Microsoft Fabric including Lakehouses, Warehouses, Data Pipeline, Mirroring and Notebooks.
• Strong programming skills in Python, PySpark and SQL.
• Experience developing scalable ETL/ELT processes with maintainable code.
• Knowledge of Delta Lake, schema evolution and data quality practices.
• Experience in monitoring, auditing, error handling and operational controls for data pipelines.
• Strong understanding of Microsoft Azure and Azure DevOps.
• Ability to work in agile teams and translate business data needs into data products.

Responsibilities

• Design, develop and support data products used across the department.
• Build robust ingestion pipelines and data transformations in Fabric Notebooks.
• Apply Medallion architecture patterns to create well-structured data lakehouses and warehouses.
• Ensure data products are observable, auditable and of high quality.
• Monitor pipeline performance and resolve issues proactively.
• Collaborate with domain experts to translate data challenges into solutions.
• Share knowledge via reusable notebooks, templates and engineering practices.

Skills

Python

PySpark

SQL

Microsoft Fabric

Azure DevOps

Data pipelines

Medallion architecture

Tools

Microsoft Fabric

Delta Lake

Azure

Azure DevOps

Job description

Do you want your work to make a difference for NSW?
Working to protect the state’s environment and heritage.

• Help shape the future of data in one of Australia’s most critical sectors
• Two X Temporary full-time opportunity up to 30 June 2028, 35 hours/week
• Parramatta preferred, with hybrid working supported
• Salary relative to experience, and ranges from $ 133,348 - $ 146,945 + super and annual leave loading
  

Are you ready to help shape the future of data in one of Australia’s most critical sectors?

Join the NSW Department of Climate Change, Energy, the Environment and Water (DCCEEW) and be part of a team that’s driving innovation at scale, leveraging cutting-edge technology to deliver insights that matter for our environment, energy, and water resources.

About the Role

As a Senior Data Engineer, you will help shape the department’s modern data environment and build the foundations that enable better decisions across climate, energy, and water management.

You will design, develop, and support trusted data products used by teams across the department. Working with subject matter experts, analysts, and other engineers, you will turn complex and diverse data sources into reliable, scalable, and accessible products that support real-world outcomes.

This role will involve:

• Designing and delivering modern data ingestion pipelines using Microsoft Fabric Data Pipelines, Mirroring, and Eventstreams.
• Building robust transformation processes in Fabric Notebooks using modular, reusable, and parameterised Python and PySpark code.
• Applying Medallion architecture patterns to create well-structured, governed, and high-performing Lakehouses and Warehouses.
• Developing data products that are reliable, observable, and fit for purpose, with strong controls for auditing, load assurance, data quality, and error handling.
• Monitoring pipeline performance and resolving issues before they affect downstream use.
• Working directly with domain experts to understand their data challenges and deliver solutions aligned with data mesh principles.
• Sharing your knowledge through reusable notebooks, templates, frameworks, and engineering practices that help lift capability across the team.
• Support and operate the department's enterprise data platform, including platform monitoring, operational support, access management, incident resolution, and the ongoing maintenance of secure and reliable data services.
• Implement and continuously improve platform governance, operational controls, monitoring, automation, and support processes to ensure data products remain available, secure, and fit for purpose.
  

You will have the opportunity to work on complex datasets, solve challenging data problems, and contribute to a growing enterprise data platform built on Microsoft Fabric.

About You

You are an experienced data engineer who enjoys turning complex data challenges into practical, reliable solutions. You are comfortable working across the full data engineering lifecycle- from ingestion and transformation through to performance optimisation, monitoring, and support.

You will bring:

• Extensive experience in a data engineering role involving the design, development, and support of production data solutions.
• Practical experience with Microsoft Fabric, including Lakehouses, Warehouses, Data Pipeline, Mirroring, and Notebooks.
• Strong programming skills in Python, PySpark, and SQL.
• Experience developing scalable ETL and ELT processes using reusable and maintainable code.
• Knowledge of Delta Lake, schema evolution, Medallion architecture, and data quality practies.
• Experience implementing monitoring, auditing, error handling, and operational controls for data pipelines.
• A strong understanding of Microsoft Azure and Azure DevOps.
• Experience working in agile teams and collaborating with technical and non-technical stakeholders.
• The ability to understand business and domain requirements and translate them into high-quality data products.
• A proactive approach to problem solving, continuous improvement, and knowledge sharing.
  

You will be someone who can work independently, contribute confidently to technical discussions, and help establish engineering standards as the department continues to grow its Microsoft Fabric capability.

For more information, read the full Role Description: Senior Data Engineer

Who we are

The Department of Climate Change, Energy, the Environment and Water (DCCEEW) works to protect the state’s environment and heritage. It leads the way on climate change, driving the sustainable transition to a net zero economy, powered by affordable, reliable, and clean energy.

DCCEEW conserves and protects the state’s natural environment. It manages the NSW national park estate, including its rich and diverse biodiversity and Aboriginal cultural heritage for future generations.

DCCEEW also ensures sustainable management of water resources across the state, to support the environment, communities and industry.

We acknowledge the ongoing custodial responsibilities of the Aboriginal peoples of NSW to care for Country and water and are committed to establishing meaningful partnerships with Aboriginal peoples in the management of the environment.

Applications close Wednesday, 28 Oct 2026 at 11:55PM.

Should you require further information about the role, please contact Damon White, Principal Data Engineer via [e-mail].

Please also note, to be eligible for an ongoing role in the NSW Public Sector you need to be an Australian Citizen or Permanent Resident. For temporary and casual roles, you need to hold a valid visa giving you permission to work in Australia as required by the role.

A recruitment pool may be created for ongoing and temporary opportunities of the same role or role type that may become available over the next 18 months.
Our goal is to build a workforce that not only represents but also understands