Data Engineer: Fabric Lakehouse & Pipelines

The HR Ally; Sydney; On-site; AUD 140,000 - 190,000; Full time

Job summary

The HR Ally is seeking a Senior Data Engineer in Sydney to design and maintain end-to-end data pipelines using Microsoft Fabric. You will build Lakehouse architectures, ingest data from diverse sources, and implement ETL/ELT with PySpark and SQL to support analytics and reporting workloads.

You will ensure data quality, governance, and secure access with Purview, RBAC, and data sensitivity labels, while collaborating with analysts and stakeholders.

Qualifications

• Experience designing enterprise data architectures with Fabric.
• Hands-on expertise with Delta Lake and Purview.
• Certifications: DP-203 or Fabric Analytics Engineer preferred.
• Strong SQL and PySpark skills.
• Ability to lead technical teams.

Responsibilities

• Design, build, and maintain end-to-end data pipelines using Fabric.
• Ingest data from multiple sources into Fabric.
• Implement ETL/ELT processes using PySpark and SQL.
• Develop Lakehouse and One Lake architectures for data assets.
• Ensure data quality, governance, and security using Purview and RBAC.
• Collaborate with stakeholders to translate requirements into scalable data solutions.
• Support CI/CD and DevOps practices for analytics workloads.

Skills

Data engineering

Fabric platforms

PySpark

SQL

CI/CD

Azure DevOps

Git

Delta Lake

Purview

Data modeling

Tools

Fabric Notebooks

Power BI

Azure Data Factory

Job description

The HR Ally is seeking a Senior Data Engineer in Sydney to design and maintain end-to-end data pipelines using Microsoft Fabric. You will build Lakehouse architectures, ingest data from diverse sources, and implement ETL/ELT with PySpark and SQL to support analytics and reporting workloads.

You will ensure data quality, governance, and secure access with Purview, RBAC, and data sensitivity labels, while collaborating with analysts and stakeholders.