Data Engineer (Microsoft Fabric and Azure)

Randstad; Brisbane; Hybrid; AUD 179,000 - 201,000; Full time

Benefits offered by this job

Udemy license for ongoing learning

Exclusive discounts across platforms

Discounts on private health funds

3 payruns a week

Job summary

Randstad Pty in Brisbane is seeking a Data Engineer to design, build, and maintain data pipelines and architectures in hybrid cloud environments for a Queensland Government Department. The role focuses on Fabric, Delta Lakes, and Azure Synapse with strong SQL skills.

You will work on data ingestion, transformation, and quality across large datasets, enabling advanced analytics and reporting. Hybrid work, initial contract through June 2027, with Randstad contractor benefits.

Qualifications

• 3+ years of data engineering experience with strong expertise in Azure Synapse, data pipelines, data lake architectures, and SQL-based tools (SSIS, SSRS).
• Design, implement, and manage scalable data solutions and transformation processes in hybrid cloud environments.
• Advanced SQL development skills for database management, performance optimisation, and data integration.
• Hands-on experience preparing and normalising large datasets for reporting, analytics, and data models.

Responsibilities

• Design, implement, and maintain data pipelines and architectures using Microsoft Fabric and Azure tools in hybrid cloud environments.
• Manage data ingestion, transformation, and storage in Fabric Lakehouses and Delta Lakes using PySpark and delta formats.
• Utilise advanced SQL development for database management, query optimisation, and systems integration.
• Monitor, troubleshoot, and resolve issues across data pipelines to ensure high availability and performance.
• Apply data quality management to normalise large datasets for analytics and reporting objectives.

Skills

Azure Synapse

PySpark

Delta Lakes

SQL

Data pipelines

Hybrid cloud

Fabric

SSIS/SSRS

Education

Any relevant qualifications

Tools

Microsoft Fabric

Delta formats

PySQL

SSIS

SSRS

Azure Synapse

Job description

Data Engineer

Client: Queensland Government Department

Pay rate: $971.60 a day + super ($1,088.20 a day including super)

Location: Brisbane CBD with WFH flexibility

Contract: initial contract until June 2027

What You Will Do:

• Design, implement, and maintain data pipelines and architectures using Microsoft Fabric and Azure tools in hybrid cloud environments.




• Manage data ingestion, transformation, and storage processes within Fabric Lakehouses and Delta Lakes utilising PySpark, PySQL, and delta formats.




• Utilise advanced SQL development techniques for database management, query optimisation, performance tuning, and systems integration.




• Monitor, troubleshoot, and resolve issues across data pipelines to guarantee high availability, performance, and reliability.




• Apply data quality management techniques to prepare and normalise large datasets, ensuring data integrity while supporting advanced analytics and reporting objectives.

What You Need to Apply for This Role:

• 3+ years of data engineering experience with strong expertise in Azure Synapse, data pipelines, data lake architectures, and SQL-based tools (SSIS, SSRS).




• Demonstrated ability to design, implement, and manage scalable data solutions and transformation processes in hybrid cloud environments.




• Advanced SQL development skills with practical experience in database management, performance optimisation, and data integration.




• Hands-on experience preparing and normalising large datasets to support reporting, advanced analytics, and data models.




• Strong background in data quality management and pipeline governance, with relevant Microsoft Azure certifications viewed favourably.

You must be a Brisbane based candidate with working rights to be considered.

Randstad contractor benefits:

• Access to a Udemy license for ongoing learning and continuous professional development




• Access to exclusive discounts across various platforms




• Discounts on private health funds




• 3 payruns a week.

At Randstad, we are passionate about providing equal employment opportunities and embracing diversity to the benefit of all. We actively encourage applications from any background.

Qualification

• Any relevant qualifications desired.