Senior Data Engineer at NSW Government

NSW Government; Sydney; On-site; AUD 133,000 - 147,000; Full time

Job summary

NSW Government is seeking a Senior Data Engineer in Sydney. You will develop secure, scalable data solutions with governance, designing end-to-end pipelines using SQL and Microsoft Fabric, and supporting the migration to Fabric across Lakehouse, Warehouse, Pipelines and Notebooks.

You will collaborate with engineering, analytics and architecture teams to deliver robust data infrastructure, ensure data security, and continually improve data workflows for reliability and scalability.

Qualifications

• Experience with Microsoft Fabric (Data Engineering, Lakehouse/Warehouse, Pipelines, Notebooks) and migration/building on Fabric is highly desirable.
• Strong SQL proficiency including query optimization, performance tuning, indexing, and stored procedures.
• Hands-on design and orchestration of ETL/ELT pipelines across ADF and/or Fabric environments.

Responsibilities

• Develop secure, scalable, and high-performance data solutions with strong governance and compliance.
• Design, develop, and optimise end-to-end data pipelines across complex environments.
• Collaborate with analytics, engineering and architecture teams to implement reusable data infrastructure.

Skills

Advanced SQL

Python

PySpark

Data governance

Data security

RBAC

Delta Lake

Lakehouse

Tools

Microsoft Fabric

Azure Data Factory

Azure Functions

Logic Apps

CI/CD pipelines

Git

Job description

Apply for Senior Data Engineer at NSW Government in Sydney Western Suburbs, NSW, AU. This Full time on site position offers great opportunities for career growth. Reference number 552796. Occupation: Database Administration, Development and Programming, Programmers. Work type: Full-Time. Location: Sydney - West. Salary information: Clerk Grade 9/10. Closing date: 20 September 2026 at 11:55pm. Shape NSW communities through innovative digital solutions. Permanent full-time opportunity, possible talent pool creation for future opportunities. Parramatta office location with flexible working supported. Salary relative to experience, ranges from $133,348 to $146,945 p.a + super.

The role: As a Senior Data Engineer, your primary role is to develop secure, scalable, and high-performance data solutions with a strong emphasis on data governance and compliance. You will design, develop, and optimise end-to-end data pipelines using SQL and Azure Data Factory, ensuring efficient data ingestion, transformation, orchestration, and storage across complex environments. Collaborating with engineering, analytics, and architecture teams, you will implement robust, reusable, and maintainable data infrastructure. The role will also play a key part in the department’s transition to Microsoft Fabric, including designing and implementing data solutions within Fabric (Lakehouse, Warehouse, Pipelines and Notebooks) and supporting the migration of existing Azure-based data platforms (ADF, Azure SQL) to Fabric. Key challenges include balancing competing demands to deliver quality services and developing broader knowledge of platforms and technologies to create more complex solutions. You will work closely with stakeholders to translate data requirements into scalable solutions, enforce data security and compliance, and continuously improve data workflows to ensure reliability and scalability.

What you will bring to the role

• Microsoft Fabric Experience: Hands-on experience with Microsoft Fabric, including Data Engineering, Lakehouse/Warehouse, Pipelines, and Notebooks. Experience in migrating or building solutions on Fabric is highly desirable.
• Advanced SQL Expertise: Strong proficiency in query optimisation, performance tuning, indexing strategies, and stored procedures.
• Azure Data Factory (ADF) & Microsoft Fabric Experience: Hands-on experience in designing, orchestrating, and optimising ETL/ELT pipelines across ADF and/or Microsoft Fabric environments.
• Azure Functions & Logic Apps: Ability to develop and deploy serverless data transformation and integration solutions.
• CI/CD Pipelines Knowledge: Strong knowledge of CI/CD pipelines, version control (Git), and automation for data solutions using Azure DevOps.
• Data Security & Governance: Understanding of RBAC, Managed Identities, and Data Masking techniques.
• Modern Data Platform Architecture: Strong understanding of modern data architectures including Lakehouse, Delta Lake, and OneLake concepts within Microsoft Fabric.
• Programming & Data Processing Languages: Strong hands-on experience in Python and PySpark, with the ability to develop and optimise data transformations using Fabric Notebooks and Spark-based processing within Lakehouse architectures.

What is an essential requirement: Microsoft Certified: Microsoft Fabric Analytics Engineer Associate (DP-700) or actively working towards certification.

About us

At the Department of Planning, Housing and Infrastructure (DPHI), you could shape your world while helping us shape the future of NSW. Together, we create vibrant communities, places and precincts, and manage land, assets and property. Join our team and shape your world in a workplace that empowers you to do your best work and build a meaningful career. In this role, you’ll help shape lives and communities across NSW while growing your own career, supported by flexible work options, impactful projects and a collaborative, diverse team. As a high-performing and inclusive organisation that reflects the communities we serve, we value your lived experience and cultural knowledge, and we are committed to helping you thrive through flexible arrangements, workplace adjustments and a culture where everyone feels supported, connected and belongs.

We encourage and support applications from people with disability. Please reach out to us to discuss any accommodations or adjustments that may be needed during the recruitment process, ensuring that you have every opportunity to showcase your talent, skills, and potential.

Please note to be eligible to apply for this position you must be an Australian or New Zealand citizen or permanent resident or hold a valid Australian working Visa for the duration of the appointment. This role is subject to pre-employment checks, including a criminal record check.

For more information contact Denniss Reddy, Manager Data Analytics at [e-mail]. A talent pool may be created for ongoing and temporary opportunities of the same role or role type that may become available over the next 18 months. Check out our Aboriginal applicants guide to assist with applying for the role or contact our Aboriginal Career Pathways team for a yarn. Contact the Talent Team via [e-mail] or [phone] - HR Support, option 2, DPHI People Advisory, option 1 and reference 'Request an Adjustment - Job Title and Reference Number'.