Senior Data Engineer

Corporate-Services,-Inc; Sydney; Hybrid; AUD 133,000 - 147,000; Full time

Benefits offered by this job

Flexible working arrangements

Superannuation

Job summary

Department of Planning, Housing and Infrastructure NSW is seeking a Senior Data Engineer in Parramatta with strong Microsoft Fabric and Azure skills. You will build scalable data pipelines, govern data assets and support the transition to Fabric across Lakehouse, Warehouse, Pipelines and Notebooks.

The role emphasises data security, compliance and collaboration with multi-disciplinary teams to deliver high-quality data solutions and future-proof architectures within NSW.

Qualifications

• Microsoft Fabric experience with Data Engineering, Lakehouse/Warehouse, Pipelines and Notebooks.
• Advanced SQL with performance tuning, indexing, and stored procedures.
• ETL/ELT design and optimisation in ADF and/or Fabric environments.
• Serverless data transformation using Azure Functions & Logic Apps.
• CI/CD pipelines and automation using Git/Azure DevOps.
• Understanding RBAC, Managed Identities and Data Masking.
• Knowledge of modern data architectures (Lakehouse, Delta Lake, OneLake) in Fabric.
• Python and PySpark for data transformations in Fabric Notebooks.

Responsibilities

• Design, develop and optimise end-to-end data pipelines with governance.
• Contribute to migration and design of data solutions in Microsoft Fabric.
• Collaborate with engineering, analytics and architecture teams.
• Ensure data security, compliance and reliable data workflows.

Skills

Microsoft Fabric experience

Advanced SQL

ADF/Microsoft Fabric

Azure Functions & Logic Apps

CI/CD (Git/Azure DevOps)

Data Security & Governance

Modern Data Platform (Lakehouse/Delta)

Python & PySpark

Tools

Azure Data Factory

Microsoft Fabric

Git

Azure DevOps

Job description

Shape NSW communities through innovative digital solutions.

• Permanent full-time opportunity, possible talentpool creation for future opportunities
• Parramatta officelocation with flexible working supported
• Salaryrelativeto experience, and ranges from $133,348to $146,945p.a+ super

The role

As a Senior Data Engineer, your primary roleis to develop secure, scalable, and high-performance data solutions with a strong emphasis on data governance and compliance. You will design, develop, and optimise end-to-end data pipelines using SQL and Azure Data Factory, ensuring efficient data ingestion, transformation, orchestration, and storage across complex environments. Collaborating with engineering, analytics, and architecture teams, you will implement robust, reusable, and maintainable data infrastructure.

The role will also play a key part in the department’s transition to Microsoft Fabric, including designing and implementing data solutions within Fabric (Lakehouse, Warehouse, Pipelines and Notebooks) and supporting the migration of existing Azure-based data platforms (ADF, Azure SQL) to Fabric.

Key challenges include balancing competing demands to deliver quality services and developing broader knowledge of platforms and technologies to create more complex solutions. You will work closely with stakeholders to translate data requirements into scalable solutions, enforce data security and compliance, and continuously improve data workflows to ensure reliability and scalability.

For more information read the full Role Description: Senior Data Engineer

What you will bringto the role

• Microsoft Fabric Experience: Hands-on experience with Microsoft Fabric, including Data Engineering, Lakehouse/Warehouse, Pipelines, and Notebooks. Experience in migrating or building solutions on Fabric is highly desirable.

• Advanced SQL Expertise: Strongproficiencyin query optimisation, performance tuning, indexing strategies, and stored procedures.

• Azure Data Factory (ADF) & Microsoft Fabric Experience:Hands-on experience in designing, orchestrating, and optimising ETL/ELT pipelines across ADF and/or Microsoft Fabric environments.

• Azure Functions & Logic Apps: Ability to develop and deploy serverless data transformation and integration solutions.

• CI/CD Pipelines Knowledge: Strong knowledge of CI/CD pipelines, version control (Git), and automation for data solutions using Azure DevOps.

• Data Security & Governance: Understanding of RBAC, Managed Identities, and Data Masking techniques.

• Modern Data Platform Architecture: Strong understanding of modern data architectures including Lakehouse, Delta Lake, andOneLakeconcepts within Microsoft Fabric

• Programming & Data Processing Languages: Strong hands-on experience in Python andPySpark, with the ability to develop and optimise data transformations using Fabric Notebooks and Spark-based processing within Lakehouse architectures.

What is an essential requirement:

• Microsoft Certified: Microsoft Fabric Analytics Engineer Associate (DP-700) or actively working towards certification.

About us

At the Department of Planning, Housing and Infrastructure (DPHI), you could shape your world while helping us shape the future of NSW. Together, we create vibrant communities, places and precincts, and manage land, assets and property.

Join our team and shape your world in a workplace that empowers you to do your best work and build a meaningful career. In this role, you’ll help shape lives and communities across NSW while growing your own career, supported by flexible work options, impactful projects and a collaborative, diverse team. As a high-performing and inclusive organisation that reflects the communities we serve, we value your lived experience and cultural knowledge, and we are committed to helping you thrive through flexible arrangements, workplace adjustments and a culture where everyone feels supported, connected and belongs.

For more information contact Denniss Reddy, Manager Data Analytics at [e-mail]

A talent pool may be created for ongoing and temporary opportunities of the same role or role type that may become available over the next 18 months.

Check out our Aboriginal applicants guide to assist with applying for the role or contact our Aboriginal Career Pathways team for a yarn.

We encourage and support applications from people with disability. Please reach out to us to discuss any accommodations or adjustments that may be needed during the recruitment process, ensuring that you have every opportunity to showcase your talent, skills, and potential. Contact the Talent Team via [e-mail] or [phone] - HR Support, option 2, DPHI People Advisory, option 1 and reference 'Request an Adjustment - Job Title and Reference Number'.

Please note to be eligible to apply for this position you must be an Australian or New Zealand citizen or permanent resident or hold a valid Australian working Visa for the duration of the appointment. This role is subject to standard pre-employment checks, including a criminal record check.

Applications close 11:55pm Sunday 20th September 2026.