AI-Powered Data Engineer for Fabric Pipelines

Resource Agility Pty; City of Melbourne; On-site; AUD 120,000 - 160,000; Full time

Benefits offered by this job

Professional development

AI‑driven culture

Stable national company

Job summary

Resource Agility Pty is seeking a Data Engineer AI to own the build, reliability and ongoing operation of a data platform on Microsoft Fabric in Melbourne. You will develop pipelines, models and quality controls turning Dynamics 365 BC and other data into a unified, high‑integrity data foundation.

You’ll work with an AI Solutions Engineer to accelerate delivery in a small, progressive team. 3–5 years of data engineering experience and hands‑on Fabric experience are essential, with strong SQL and

Qualifications

• 3–5 years of data engineering experience building and supporting production pipelines.
• Hands‑on experience with Microsoft Fabric stack (Lakehouse, Data Factory pipelines, Dataflows Gen2, notebooks).
• Strong SQL and PySpark for transformation, modeling, and performance tuning.
• Practical experience with medallion architecture and dimensional modelling.
• Comfort with AI coding assistants to accelerate development while validating outputs.
• Clear communication to explain data issues to non‑technical stakeholders.

Responsibilities

• Build, schedule, and maintain Fabric pipelines, notebooks, and dataflows in medallion architecture.
• Design conformed dimensions and fact tables for historical data migrations and backfills.
• Monitor pipeline health, manage incremental loads, and optimize capacity usage.
• Implement automated data quality checks and reconciliations to source data.
• Manage DevOps workflows using Azure DevOps, Git, and Fabric deployment pipelines.

Skills

Data engineering

SQL

PySpark

Dimensional modelling

Medallion architecture

Data quality

AI coding assistants

Communication

Tools

Microsoft Fabric

Azure DevOps

Git

Azure Data Factory

ADLS

Azure Synapse

Job description

Resource Agility Pty is seeking a Data Engineer AI to own the build, reliability and ongoing operation of a data platform on Microsoft Fabric in Melbourne. You will develop pipelines, models and quality controls turning Dynamics 365 BC and other data into a unified, high‑integrity data foundation.

You’ll work with an AI Solutions Engineer to accelerate delivery in a small, progressive team. 3–5 years of data engineering experience and hands‑on Fabric experience are essential, with strong SQL and