Senior Data Engineer - Data & Ai

Myob; Sydney; Híbrido; AUD 140.000 - 190.000; Jornada completa

Descripción de la vacante

Agile Insights is seeking an experienced Senior Data Engineer to design and build modern data platforms on Microsoft Fabric, collaborating with clients across government and enterprise projects. You will work in a hybrid Sydney-based role with occasional travel to client sites.

You bring hands-on Fabric delivery, strong Python and SQL, and a proactive consulting mindset to run workshops, mentor others, and balance multiple projects while delivering scalable data solutions.

Formación

• Microsoft Fabric hands-on delivery across Lakehouse, OneLake, Data Factory/pipelines, Notebooks, Warehouse, and semantic models.
• Strong Python and SQL, including Spark-based transformation and performance tuning.
• Modern data architecture with lakehouse and medallion patterns; batch/incremental ingestion; data quality.
• CI/CD and DevOps practices with source control and deployment pipelines using Azure DevOps and/or GitHub.
• Power BI experience building and optimizing datasets and reports.
• Consulting delivery experience and ability to run workshops; manage multiple projects.
• Full, unrestricted Australian work rights and based in Australia.

Responsabilidades

• Design and build modern data platforms on Microsoft Fabric for multiple clients.
• Collaborate with project teams, mentor colleagues, and communicate with technical and business stakeholders.
• Lead workshops and drive delivery across multiple concurrent projects.

Conocimientos

Fabric delivery

Python

SQL

Data architecture

CI/CD

Power BI

Consulting delivery

Stakeholder comms

Enterprise data migration

Herramientas

Databricks

Microsoft Purview

Azure DevOps

GitHub

Descripción del empleo

Job Description

About Us

At Agile Insights, we are passionate about empowering organisations to transform through the power of Data & AI. We are an independent, Australian-owned consulting firm and one of Australia’s leading Microsoft Data & AI partners — placed in the top 1% globally for Microsoft Data and AI expertise. We are a Microsoft Solutions Partner and Trusted Advanced Specialisation Partner, as well as a Databricks and ESRI partner.

We work with government agencies and mid-to-large enterprises across energy and utilities, financial services, healthcare, education, local government, retail, and transport — delivering modern data platforms, analytics, governance, and AI solutions end to end.

The Role

We’re seeking an experienced Senior Data Engineer to design and build modern data platforms on Microsoft Fabric, working across multiple clients and projects as part of our Data & Analytics Practice.

Sydney is our preferred location, but we will consider strong candidates based in other Australian states.

What you’ll bring (essential)

• Microsoft Fabric — hands‑on delivery experience across Lakehouse, OneLake, Data Factory / pipelines, Notebooks, Warehouse, and semantic models. Fabric is the primary technology for this role.
• Strong Python and SQL, including Spark‑based transformation and performance tuning.
• Modern data architecture — lakehouse and medallion patterns, dimensional modelling, batch and incremental ingestion, data quality.
• CI/CD and DevOps practices — source control and deployment pipelines using Azure DevOps and/or GitHub (Git branching strategies, automated deployment of data assets, environment promotion).
• Power BI — building and optimising datasets and reports on top of the platforms you deliver.
• Consulting delivery experience — comfortable working directly with clients, running workshops, and balancing multiple concurrent projects and priorities.
• Strong teamwork and communication — you work collaboratively in project teams, share knowledge, mentor others, and communicate confidently with both technical and business stakeholders.
• Experience supporting enterprise data migration and transformation programs.
• Full, unrestricted Australian work rights and based in Australia.

Nice to have

• Databricks — Lakehouse architecture, Delta Lake, Spark pipeline design and optimisation, Unity Catalog.
• Microsoft Purview — data governance, Data Hub / Unified Catalog, data quality, lineage, classification, sensitivity labelling, and compliance.
• Experience delivering into Australian government or other regulated environments.
• Microsoft and/or Databricks certifications (e.g. DP‑600, DP‑700).

Ways of working

This is a hybrid role, based in Sydney by preference (other Australian states considered). In line with company direction, you’ll spend a few days each week at the Agile Insights office and/or client offices, with the balance working from home.

What’s In It for You?

At Agile Insights, we believe in nurturing talent and creating a supportive, flexible, and rewarding workplace. Here’s what you can look forward to:

• Wellbeing: Access to hybrid work arrangements, an Employee Assistance Program, and an individualised gym and wellbeing program.
• Flexibility: Work from anywhere for up to 6 weeks per year.
• Professional Development: Additional paid leave for certifications and exams, with Agile-sponsored training programs for Microsoft and Databricks certifications.
• Team Engagement: Enjoy regular team meetups, including state‑based gatherings and an annual all‑company event.
• Equipment & Hardware: Receive an allowance for your home office setup and a 2‑year equipment incentive.
• Salary Packaging: Access novated leasing services for tax‑effective car purchases.
• Learning Resources: Expand your skills with access to our digital library and learning platforms. Opportunity to work with some of the best developers in the business including one‑on‑one mentoring with senior consultants.

Why Agile Insights?

Work with some of the largest clients and global brands across diverse industries. Be part of a fast‑growing, award‑winning team passionate about transforming organisations with Data & AI. Thrive in a friendly start‑up culture that values innovation, collaboration, and work‑life balance.