Scrum Master

My NRMA; Sydney; Hybrid; AUD 140,000 - 190,000; Full time

Job summary

Agile Insights is seeking a Senior Data Engineer to design and build modern data platforms on Microsoft Fabric for multiple clients. You’ll collaborate with the Data & Analytics Practice, work across projects, and contribute to end‑to‑end data solutions.

Preferred location is Sydney, but strong candidates from other states will be considered. The role involves client workshops, cross‑functional teamwork, and delivering on data migration and transformation initiatives while based in Australia

Qualifications

• Hands‑on delivery experience with Microsoft Fabric across Lakehouse, OneLake, Data Factory/pipelines, Notebooks, Warehouse, and semantic models.
• Strong Python and SQL skills, including Spark‑based transformation and performance tuning.
• Experience designing modern data architectures (lakehouse, medallion patterns, dimensional modelling).
• CI/CD and DevOps practices using Azure DevOps and/or GitHub with automated deployment of data assets.
• Power BI experience for datasets and reports on delivered platforms.
• Consulting delivery experience with direct client engagement and workshops.
• Ability to manage multiple concurrent projects with strong teamwork and communication.
• Experience supporting enterprise data migration and transformation programs.
• Full, unrestricted Australian work rights; based in Australia.

Skills

Microsoft Fabric

Python

SQL

Data architecture

CI/CD

Azure DevOps

GitHub

Power BI

Consulting delivery

stakeholder communication

enterprise data migration

Tools

Azure DevOps

GitHub

Databricks

Job description

Job Description

About Us

At Agile Insights, we are passionate about empowering organisations to transform through the power of Data & AI. We are an independent, Australian-owned consulting firm and one of Australia’s leading Microsoft Data & AI partners — placed in the top 1% globally for Microsoft Data and AI expertise. We are a Microsoft Solutions Partner and Trusted Advanced Specialisation Partner, as well as a Databricks and ESRI partner.

We work with government agencies and mid-to-large enterprises across energy and utilities, financial services, healthcare, education, local government, retail, and transport — delivering modern data platforms, analytics, governance, and AI solutions end to end.

The Role

We’re seeking an experienced Senior Data Engineer to design and build modern data platforms on Microsoft Fabric, working across multiple clients and projects as part of our Data & Analytics Practice.

Sydney is our preferred location, but we will consider strong candidates based in other Australian states.

What you’ll bring (essential)

• Microsoft Fabric — hands‑on delivery experience across Lakehouse, OneLake, Data Factory / pipelines, Notebooks, Warehouse, and semantic models. Fabric is the primary technology for this role.
• Strong Python and SQL, including Spark‑based transformation and performance tuning.
• Modern data architecture — lakehouse and medallion patterns, dimensional modelling, batch and incremental ingestion, data quality.
• CI/CD and DevOps practices — source control and deployment pipelines using Azure DevOps and/or GitHub (Git branching strategies, automated deployment of data assets, environment promotion).
• Power BI — building and optimising datasets and reports on top of the platforms you deliver.
• Consulting delivery experience — comfortable working directly with clients, running workshops, and balancing multiple concurrent projects and priorities.
• Strong teamwork and communication — you work collaboratively in project teams, share knowledge, mentor others, and communicate confidently with both technical and business stakeholders.
• Experience supporting enterprise data migration and transformation programs.
• Full, unrestricted Australian work rights and based in Australia.

Nice to have

• Databricks — Lakehouse architecture, Delta Lake, Spark pipeline design and optimisation, Unity Catalog.
• Microsoft Purview — data governance, Data Hub / Unified Catalog, data quality, lineage, classification, sensitivity labelling, and compliance.
• Experience delivering into Australian government or other regulated environments.
• Microsoft and/or Databricks certifications (e.g.DP-600, DP-700).

Ways of working

This is a hybrid role, based in Sydney by preference (other Australian states considered). In line with company direction, you’ll spend a few days each week at the Agile Insights office and/or client offices, with the balance working from home.

What’s In It for You?

At Agile Insights, we believe in nurturing talent and creating a supportive, flexible, and rewarding workplace. Here’s what you can look forward to:

• Wellbeing: Access to hybrid work arrangements, an Employee Assistance Program, and an individualised gym and wellbeing program.
• Flexibility: Work from anywhere for up to 6 weeks per year.
• Professional Development: Additional paid leave for certifications and exams, with Agile-sponsored training programs for Microsoft and Databricks certifications.
• Team Engagement: Enjoy regular team meetups, including state-based gatherings and an annual all-company event.
• Equipment & Hardware: Receive an allowance for your home office setup and a 2-year equipment incentive.
• Salary Packaging: Access novated leasing services for tax-effective car purchases.
• Learning Resources: Expand your skills with access to our digital library and learning platforms. Opportunity to work with some of the best developers in the business including one on one mentoring with senior consultants.

Why Agile Insights?

Work with some of the largest clients and global brands across diverse industries. Be part of a fast‑growing, award‑winning team passionate about transforming organisations with Data & AI. Thrive in a friendly start‑up culture that values innovation, collaboration, and work‑life balance.

Ready to Join Us?

If you’re passionate about data engineering, modern data platforms, and consulting, we’d love to hear from you.

Must be based in Australia (Sydney preferred) and have full Australian work rights