Lead Data Engineer – Hybrid, Climate & Water

Wattyl Australia Pty; Sydney; Hybrid; AUD 133.000 - 147.000; Vollzeit

Zusammenfassung

NSW Department of Climate Change, Energy, the Environment and Water (DCCEEW) is seeking a Senior Data Engineer to shape a modern data environment and build scalable data products for climate, energy and water management. You will design, develop, and support trusted data products, turning diverse data sources into reliable lakehouse-based solutions using Microsoft Fabric.

Join a team delivering insights that matter for NSW's environment and resources with hybrid work in Parramatta and a salary

Qualifikationen

• Extensive experience in data engineering delivering production data solutions.
• Practical experience with Microsoft Fabric and data lakehouse patterns.
• Strong Python, PySpark and SQL coding skills.
• Knowledge of Delta Lake, schema evolution and data quality.

Aufgaben

• Design, develop and support data products for climate, energy and water domains.
• Build robust transformations and governance for scalable lakehouses/warehouses.
• Monitor pipelines and ensure data quality and audit controls.
• Collaborate with domain experts and stakeholders in an agile team.

Kenntnisse

Python

PySpark

SQL

Delta Lake

Medallion architecture

Data quality

Microsoft Fabric

Lakehouses

Warehouses

Tools

Notebooks

DataPipeline

Mirroring

Jobbeschreibung

NSW Department of Climate Change, Energy, the Environment and Water (DCCEEW) is seeking a Senior Data Engineer to shape a modern data environment and build scalable data products for climate, energy and water management. You will design, develop, and support trusted data products, turning diverse data sources into reliable lakehouse-based solutions using Microsoft Fabric.

Join a team delivering insights that matter for NSW's environment and resources with hybrid work in Parramatta and a salary