Senior Data Engineer

Hudson AU; Brisbane; On-site; AUD 140,000 - 190,000; Full time

Job summary

Hudson partners with a Queensland Government agency to recruit an experienced Senior Data Engineer for a major data platform project. You will design and build scalable data pipelines and reusable data products on a cloud-based ecosystem using Microsoft Fabric and Azure.

You will work in an Agile delivery team with data architects, developers and business stakeholders to ensure data reliability, security and ready-to-use datasets for analytics and reporting.

Qualifications

• Strong hands-on data engineering experience in complex enterprise environments.
• Proven experience with Microsoft Fabric including Lakehouses and pipelines.
• Experience designing and maintaining ETL/ELT pipelines and data products.
• Knowledge of medallion architecture and data governance practices.

Responsibilities

• Design, build and maintain data pipelines, lakehouses and warehouses.
• Develop ETL/ELT processes and medallion layers (Bronze, Silver, Gold).
• Integrate data from Dynamics 365, Dataverse and Azure services.
• Implement data quality checks, validation and monitoring.
• Support curated datasets, data models and Power BI reporting.
• Collaborate with architects, developers and stakeholders to deliver quality solutions.

Skills

Microsoft Fabric

ETL/ELT pipelines

SQL

Azure DevOps

Data governance & security

Tools

Power BI

PySpark

Dataverse

Azure Synapse

Job description

We're partnering with a Queensland Government agency to find an experienced Senior Data Engineer to join a major data platform project currently in the build stage. This is an opportunity to contribute to the development of a modern, cloud-based data ecosystem, building scalable data pipelines and reusable data products that support integration, migration, reporting and analytics.

The Opportunity

Working within an Agile delivery team, you'll collaborate with data and solution architects, developers, analysts and business stakeholders to design, build and support enterprise data engineering solutions using Microsoft Fabric and Azure technologies.

You'll play a key role in ensuring data is reliable, secure, well-structured and ready to support business and operational needs.

• Design, build and maintain data pipelines, transformations, lakehouses and warehouses using Microsoft Fabric.
• Develop and manage ETL/ELT processes and medallion architecture layers (Bronze, Silver and Gold).
• Integrate data from Dynamics 365, Dataverse, Azure services and other enterprise systems.
• Implement data quality checks, validation, reconciliation, monitoring and error handling.
• Support curated datasets, data models, semantic layers and Power BI reporting.
• Contribute to CI/CD, source control, testing and deployment processes using Azure DevOps or similar tools.
• Collaborate with technical teams and stakeholders to validate solutions, resolve issues and deliver quality outcomes.

About You

You'll bring strong hands-on data engineering experience in complex enterprise environments, with the ability to work independently and deliver production-ready solutions.

You'll ideally have:

• Strong experience with Microsoft Fabric, including Lakehouses, Warehouses, OneLake, pipelines, notebooks and dataflows.
• Proven experience building ETL/ELT pipelines, data transformations and reusable data products.
• Strong SQL skills and experience working with structured and semi-structured data.
• Experience with medallion architecture or similar layered data patterns.
• Experience integrating data from Dynamics 365, Dataverse or comparable enterprise platforms.
• Knowledge of Azure DevOps, CI/CD, data governance, security and data quality.
• Experience working in Agile delivery teams.

Experience with Fabric Link for Dataverse, Azure Synapse Link, PySpark, Python, Dataflow Gen2 and Power BI will be highly regarded.

Diversity, Equity & Inclusion at Hudson

Hudson is committed to helping you find a workplace where you feel respected, supported, and free to thrive. We welcome applications from all backgrounds, identities, and lived experiences—because when different voices come together, amazing things happen

Casual Loading

Please note for all Australian based contract and temporary roles only, the pay rate is inclusiveofmandatory 25% casual loading. This excludes permanent and fixed term roles.

Due to current Victorian labour hire licence restrictions, Hudson is not advertising, offering or accepting applications for contract, temporary or labour hire roles that are based in Victoria or otherwise connected to Victoria. This includes contract, temporary or labour hire roles where the candidate resides in Victoria, even if the role is based in another state. These restrictions do not apply to permanent or fixed term employment opportunities.