Senior Data Engineer: Cloud Data Pipelines & Fabric

Hudson AU; Brisbane; On-site; AUD 140,000 - 190,000; Full time

Job summary

Hudson partners with a Queensland Government agency to recruit an experienced Senior Data Engineer for a major data platform project. You will design and build scalable data pipelines and reusable data products on a cloud-based ecosystem using Microsoft Fabric and Azure.

You will work in an Agile delivery team with data architects, developers and business stakeholders to ensure data reliability, security and ready-to-use datasets for analytics and reporting.

Qualifications

• Strong hands-on data engineering experience in complex enterprise environments.
• Proven experience with Microsoft Fabric including Lakehouses and pipelines.
• Experience designing and maintaining ETL/ELT pipelines and data products.
• Knowledge of medallion architecture and data governance practices.

Responsibilities

• Design, build and maintain data pipelines, lakehouses and warehouses.
• Develop ETL/ELT processes and medallion layers (Bronze, Silver, Gold).
• Integrate data from Dynamics 365, Dataverse and Azure services.
• Implement data quality checks, validation and monitoring.
• Support curated datasets, data models and Power BI reporting.
• Collaborate with architects, developers and stakeholders to deliver quality solutions.

Skills

Microsoft Fabric

ETL/ELT pipelines

SQL

Azure DevOps

Data governance & security

Tools

Power BI

PySpark

Dataverse

Azure Synapse

Job description

Hudson partners with a Queensland Government agency to recruit an experienced Senior Data Engineer for a major data platform project. You will design and build scalable data pipelines and reusable data products on a cloud-based ecosystem using Microsoft Fabric and Azure.

You will work in an Agile delivery team with data architects, developers and business stakeholders to ensure data reliability, security and ready-to-use datasets for analytics and reporting.