Senior Data Engineer

randstad digital australia; Brisbane; Hybrid; AUD 130,000 - 170,000; Full time

Benefits offered by this job

Udemy license for ongoing learning

Exclusive discounts across platforms

Private health fund discounts

3 payruns a week

Job summary

Randstad is partnering with a Queensland Government Department to recruit a Senior Data Engineer for a 12-month contract with potential extension. The role is based in Brisbane CBD with work-from-home flexibility.

You will design and build scalable data pipelines across Microsoft Fabric, Dynamics 365, Dataverse, and Azure-aligned delivery streams within an Agile team, delivering trusted analytics assets and reusable data products.

Qualifications

• Proven experience designing building ETL/ELT pipelines and medallion-layer data architecture.
• Strong SQL skills for profiling transforming validating and reconciling data.
• Experience working in Agile teams with CI/CD tools like Azure DevOps.

Responsibilities

• Design, build, test, and support scalable data pipelines, transformations, lakehouses, warehouses, and data products using Microsoft Fabric.
• Move data through raw transformed and curated medallion-layer architectures for reporting analytics and migration needs.
• Ingest data from Dynamics 365 Dataverse Power Platform and Azure services leveraging Fabric Link for Dataverse where appropriate.
• Implement data quality controls validation reconciliation logging and error monitoring across data processes.
• Collaborate in Agile delivery teams to validate data patterns and mitigate integration risks early.

Skills

ETL/ELT pipelines

SQL analytics

Agile methodologies

Data quality controls

Cloud - Azure

Tools

Microsoft Fabric

Azure DevOps

Dataverse

Job description

Randstad is currently working with a Queensland Government Department to find a Senior Data Engineer for an initial 12 Month Contract with potential of extension. This role is based in Brisbane CBD with WFH flexibility.

Role: Senior Data Engineer

Client: Queensland Government Department

Contract Length: 12 Months with potential of extension

Location: Brisbane CBD with WFH flexibility

Pay Rate: Open Market Rates

Submission Date: ASAP

Role Overview:

We are seeking a skilled professional to design, build, test, and support scalable data pipelines, transformations, medallion-layer structures, and reusable data products across Microsoft Fabric, Dynamics 365, Dataverse, Power Platform, and Azure-aligned delivery streams. Working within an Agile delivery team, you will collaborate closely with architects, developers, testers, and business stakeholders to turn complex data into trusted, high-value analytics assets.

What You Will Do:

• Design, build, test, and support scalable data pipelines, data transformations, lakehouses, warehouses, and reusable data products using Microsoft Fabric.
• Move data through raw, transformed, and curated medallion-layer architectures to support enterprise reporting, analytics, migration, and integration needs.
• Ingest and engineer data from Dynamics 365, Dataverse, Power Platform, and Azure services, leveraging Fabric Link for Dataverse where appropriate.
• Implement data quality controls, validation, reconciliation, logging, exception handling, and error monitoring across data processes.
• Work in Agile delivery teams using fail-fast prototyping, spikes, and proof-of-concepts to validate data patterns and resolve integration risks early.

What You Need to Apply for This Role:

• Strong hands-on experience with Microsoft Fabric, including lakehouses, warehouses, OneLake, pipelines, notebooks, dataflows, and SQL analytics endpoints.
• Demonstrated expertise designing and building ETL/ELT data pipelines, medallion-layer architecture (raw, transformed, curated layers), and reusable data structures.
• Proven experience ingesting and engineering data from Dynamics 365, Dataverse, Power Platform, or comparable enterprise applications.
• Strong SQL skills with extensive experience profiling, transforming, validating, and reconciling structured and semi-structured datasets.
• Experience working in Agile environments with CI/CD tools like Azure DevOps, focusing on data quality, security, and release readiness.

You must be a Brisbane based candidate with unlimited working rights to be considered.

Randstad contractor benefits:

• Access to a Udemy license for ongoing learning and continuous professional development
• Access to exclusive discounts across various platforms
• Discounts on private health funds
• 3 payruns a week.

At Randstad, we are passionate about providing equal employment opportunities and embracing diversity to the benefit of all. We actively encourage applications from any background.