Senior Data Engineer

Department of Climate Change, Energy, the Environment and Water; Parramatta; Hybrid; AUD 133,000 - 147,000; Full time

Job summary

The NSW Department of Climate Change, Energy, the Environment and Water invites applications for a Senior Data Engineer in Parramatta. You will help shape the department’s modern data environment, design, develop, and support trusted data products used across climate, energy, and water management.

You will implement modern ingestion pipelines with Microsoft Fabric, build robust transformations in Fabric Notebooks, apply Medallion architecture, and ensure data quality, security, and governance

Qualifications

• Extensive experience in a data engineering role delivering production data solutions.
• Hands-on with Microsoft Fabric including Lakehouses, Warehouses, Data Pipeline, Mirroring, and Notebooks.
• Strong programming skills in Python, PySpark, and SQL.
• Experience developing scalable ETL/ELT processes with reusable, maintainable code.
• Knowledge of Delta Lake, schema evolution, Medallion architecture, and data quality practices.
• Experience implementing monitoring, auditing, error handling, and operational controls for data pipelines.
• Strong understanding of Microsoft Azure and Azure DevOps.
• Experience working in agile teams and collaborating with stakeholders.
• Ability translating business requirements into high-quality data products.

Responsibilities

• Design and deliver modern data ingestion pipelines using Microsoft Fabric Data Pipelines, Mirroring, and Eventstreams.
• Build robust transformations in Fabric Notebooks with modular, reusable PySpark and Python code.
• Apply Medallion architecture to create well-structured Lakehouses and Warehouses.
• Develop data products that are reliable, observable, and governed with strong data-quality controls.
• Monitor pipeline performance and resolve issues to protect downstream use.
• Collaborate with domain experts to translate data challenges into solutions aligned with data mesh principles.
• Share knowledge through notebooks, templates, frameworks to lift capability across the team.
• Support and operate the enterprise data platform including monitoring, access management, and incident resolution.

Skills

Python

PySpark

SQL

Agile teamwork

Data quality

Tools

Microsoft Fabric

Lakehouses

Warehouses

Data Pipeline

Mirroring

Notebooks

Microsoft Azure

Azure DevOps

Delta Lake

Job description

Do you want your work to make a difference for NSW? Working to protect the state’s environment and heritage.

• Help shape the future of data in one of Australia’s most critical sectors
• Two X Temporary full-time opportunity up to 30 June 2028, 35 hours/week
• Parramatta preferred, with hybrid working supported
• Salary relative to experience, and ranges from $ 133,348 - $ 146,945 + super and annual leave loading

Are you ready to help shape the future of data in one of Australia’s most critical sectors? Join the NSW Department of Climate Change, Energy, the Environment and Water (DCCEEW) and be part of a team that’s driving innovation at scale, leveraging cutting-edge technology to deliver insights that matter for our environment, energy, and water resources.

About the Role

As a Senior Data Engineer , you will help shape the department’s modern data environment and build the foundations that enable better decisions across climate, energy, and water management. You will design, develop, and support trusted data products used by teams across the department. Working with subject matter experts, analysts, and other engineers, you will turn complex and diverse data sources into reliable, scalable, and accessible products that support real-world outcomes.

This role will involve:

• Designing and delivering modern data ingestion pipelines using Microsoft Fabric Data Pipelines, Mirroring, and Eventstreams.
• Building robust transformation processes in Fabric Notebooks using modular, reusable, and parameterised Python and PySpark code.
• Applying Medallion architecture patterns to create well-structured, governed, and high-performing Lakehouses and Warehouses.
• Developing data products that are reliable, observable, and fit for purpose, with strong controls for auditing, load assurance, data quality, and error handling.
• Monitoring pipeline performance and resolving issues before they affect downstream use.
• Working directly with domain experts to understand their data challenges and deliver solutions aligned with data mesh principles.
• Sharing your knowledge through reusable notebooks, templates, frameworks, and engineering practices that help lift capability across the team.
• Support and operate the department's enterprise data platform, including platform monitoring, operational support, access management, incident resolution, and the ongoing maintenance of secure and reliable data services.
• Implement and continuously improve platform governance, operational controls, monitoring, automation, and support processes to ensure data products remain available, secure, and fit for purpose.

You will have the opportunity to work on complex datasets, solve challenging data problems, and contribute to a growing enterprise data platform built on Microsoft Fabric.

About You

You are an experienced data engineer who enjoys turning complex data challenges into practical, reliable solutions. You are comfortable working across the full data engineering lifecycle—from ingestion and transformation through to performance optimisation, monitoring, and support. You will bring:

• Extensive experience in a data engineering role involving the design, development, and support of production data solutions.
• Practical experience with Microsoft Fabric, including Lakehouses, Warehouses, Data Pipeline, Mirroring, and Notebooks.
• Strong programming skills in Python, PySpark, and SQL.
• Experience developing scalable ETL and ELT processes using reusable and maintainable code.
• Knowledge of Delta Lake, schema evolution, Medallion architecture, and data quality practies.
• Experience implementing monitoring, auditing, error handling, and operational controls for data pipelines.
• A strong understanding of Microsoft Azure and Azure DevOps.
• Experience working in agile teams and collaborating with technical and non-technical stakeholders.
• The ability to understand business and domain requirements and translate them into high-quality data products.
• A proactive approach to problem solving, continuous improvement, and knowledge sharing.

You will be someone who can work independently, contribute confidently to technical discussions, and help establish engineering standards as the department continues to grow its Microsoft Fabric capability.

For more information

For more information, read the full Role Description: Senior Data Engineer

Who we are

The Department of Climate Change, Energy, the Environment and Water (DCCEEW) works to protect the state’s environment and heritage. It leads the way on climate change, driving the sustainable transition to a net zero economy, powered by affordable, reliable, and clean energy. DCCEEW conserves and protects the state’s natural environment. It manages the NSW national park estate, including its rich and diverse biodiversity and Aboriginal cultural heritage for future generations. DCCEEW also ensures sustainable management of water resources across the state, to support the environment, communities and industry. We acknowledge the ongoing custodial responsibilities of the Aboriginal peoples of NSW to care for Country and water and are committed to establishing meaningful partnerships with Aboriginal peoples in the management of the environment.

Should you require further information about the role, please contact Damon White, Principal Data Engineer via [e-mail]. Please also note, to be eligible for an ongoing role in the NSW Public Sector you need to be an Australian Citizen or Permanent Resident. For temporary and casual roles, you need to hold a valid visa giving you permission to work in Australia as required by the role.

Applications close Wednesday, 28 Oct 2026 at 11:55PM.

Our workforce represents people of all ages and genders, Aboriginal and Torres Strait Islander people, people with disabilities, the LGBTQI+ community, and people from diverse ethnic and cultural backgrounds. We are committed to making our state a vibrant and inclusive place to live, work, and thrive for everyone.

Looking for more information or assistance in applying?

• Our commitment to a diverse and inclusive workplace.
• How we encourage and support people with disability
• Information and adjustments for individual needs for the recruitment process and the workplace.

If you require an adjustment for your application process, please contact our Talent Acquisition Team by emailing [e-mail] or contacting Nivya Shetty on 02 9585 6607 or via [e-mail] (please mention reference number 553410).

If you are an Aboriginal or Torres Strait Islander use our Guide for Aboriginal Applicants to assist with applying for roles or contact our Aboriginal Career pathways team for a yarn.

Find us on Facebook , Instagram , X (Twitter), YouTube and LinkedIn . Role Description