Senior Data Engineer

Randstad Digital; Brisbane; Hybrid; AUD 120,000 - 160,000; Full time

Benefits offered by this job

Udemy license

Exclusive discounts

Private health fund discounts

Three payruns per week

Job summary

Randstad is partnering with a Queensland Government Department to hire a Senior Data Engineer for a 12-month contract in Brisbane CBD with flexible WFH. You will design, build, test, and support scalable data pipelines and medallion-layer architectures using Microsoft Fabric and Azure services.

You will ingest data from Dynamics 365, Dataverse, Power Platform, and Azure, implementing data quality controls within an Agile delivery team.

Qualifications

• Strong hands-on experience with Microsoft Fabric including lakehouses, warehouses, OneLake, pipelines, notebooks, dataflows, and SQL analytics endpoints.
• Experience designing and building ETL/ELT data pipelines with medallion-layer architecture (raw, transformed, curated).
• Proven experience ingesting data from Dynamics 365, Dataverse, Power Platform, or comparable enterprise apps.
• Strong SQL skills with profiling, transforming, validating, and reconciling structured and semi-structured data.
• Experience in Agile environments with CI/CD tools like Azure DevOps, focusing on data quality and release readiness.

Responsibilities

• Design, build, test, and support scalable data pipelines and data products using Microsoft Fabric.
• Move data through medallion-layer architectures to support enterprise reporting and analytics.
• Ingest data from Dynamics 365, Dataverse, Power Platform, and Azure services; leverage Fabric Link where appropriate.
• Implement data quality controls, logging, and error monitoring across data processes.
• Collaborate in Agile teams to validate data patterns and address integration risks early.

Skills

Microsoft Fabric

ETL/ELT pipelines

SQL analytics

Azure data services

Agile / CI-CD

Tools

Azure DevOps

Dynamics 365

Dataverse

Power Platform

Microsoft Fabric components

Job description

Randstad is currently working with a Queensland Government Department to find a Senior Data Engineer for an initial 12 Month Contract with potential of extension. This role is based in Brisbane CBD with WFH flexibility.

Role: Senior Data Engineer

Client: Queensland Government Department

Contract Length: 12 Months with potential of extension

Location: Brisbane CBD with WFH flexibility

Pay Rate: Open Market Rates

Submission Date: ASAP

Role Overview

We are seeking a skilled professional to design, build, test, and support scalable data pipelines, transformations, medallion-layer structures, and reusable data products across Microsoft Fabric, Dynamics 365, Dataverse, Power Platform, and Azure-aligned delivery streams. Working within an Agile delivery team, you will collaborate closely with architects, developers, testers, and business stakeholders to turn complex data into trusted, high-value analytics assets.

What You Will Do

• Design, build, test, and support scalable data pipelines, data transformations, lakehouses, warehouses, and reusable data products using Microsoft Fabric.
• Move data through raw, transformed, and curated medallion-layer architectures to support enterprise reporting, analytics, migration, and integration needs.
• Ingest and engineer data from Dynamics 365, Dataverse, Power Platform, and Azure services, leveraging Fabric Link for Dataverse where appropriate.
• Implement data quality controls, validation, reconciliation, logging, exception handling, and error monitoring across data processes.
• Work in Agile delivery teams using fail-fast prototyping, spikes, and proof-of-concepts to validate data patterns and resolve integration risks early.

What You Need to Apply for This Role

• Strong hands-on experience with Microsoft Fabric, including lakehouses, warehouses, OneLake, pipelines, notebooks, dataflows, and SQL analytics endpoints.
• Demonstrated expertise designing and building ETL/ELT data pipelines, medallion-layer architecture (raw, transformed, curated layers), and reusable data structures.
• Proven experience ingesting and engineering data from Dynamics 365, Dataverse, Power Platform, or comparable enterprise applications.
• Strong SQL skills with extensive experience profiling, transforming, validating, and reconciling structured and semi-structured datasets.
• Experience working in Agile environments with CI/CD tools like Azure DevOps, focusing on data quality, security, and release readiness.

You must be a Brisbane based candidate with unlimited working rights to be considered.

Randstad contractor benefits

• Access to a Udemy license for ongoing learning and continuous professional development
• Access to exclusive discounts across various platforms
• Discounts on private health funds
• 3 payruns a week.

At Randstad, we are passionate about providing equal employment opportunities and embracing diversity to the benefit of all. We actively encourage applications from any background.