Principal Data Engineer

Department of Families, Fairness & Housing

Melbourne

On-site

AUD 143,000 - 191,000

Full time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

The Department of Families, Fairness & Housing Victoria is seeking a Principal Data Engineer to design, develop and implement a modern data platform centred on Databricks. You will translate complex data requirements into robust solutions across batch and real-time processing.

Reporting to the Chief Architect, you will work with solution architects and cyber security teams to ensure secure, scalable data integration and governance across the transformation program.

Responsibilities

  • Design, build and maintain resilient, scalable and observable data solutions from ingestion through to automated operations.
  • Implement resilient and reusable data engineering components, including validation, error handling, recovery processes and monitoring, to support operational reliability and data integrity in line with CFTP frameworks.
  • Architect pipelines, ingestion processes and integration solutions to support departmental data platforms, including batch and near-real-time data flows.

Job description

$142,790 - $191,084(ft equivalent per annum)+Super

The Communities and Families Transformation Program (CFTP) is a large-scale service transformation program that will replace legacy case management systems and deliver modern tools to approximately 10,000 users across nine program areas in the Department of Families, Fairness and Housing (DFFH) and the Department of Justice and Community Safety (DJCS). The program will also deliver improved case management and reporting capabilities to Community Sector Organisations (CSOs) and Aboriginally Controlled Community Organisations (ACCOs). The program will redesign how services are delivered to improve efficiency and outcomes while enhancing compliance and data privacy and security.

The first tranche of work, spanning three years, has been funded by government and will deliver: replacement of IRIS (the legacy sector reporting system); service design for Child Protection; complete foundational technology design and build; and procurement.

Reporting to the Chief Architect, the Principal Data Engineer is responsible for the design, development, and implementation of a modern enterprise data platform, centred on Databricks and aligned with Victorian Government digital, data, and cloud strategies. The role will provide technical expertise across data engineering, data architecture, solution architecture, and complex data migration.

The role leads complex technical work of high strategic importance and risk, translating whole-of-organisation data and analytics objectives into robust, secure, and scalable platform solutions. It operates with a high degree of autonomy and professional judgement and is recognised as a subject matter expert across data platform architecture.

The role works closely with solution architects, business subject matter experts, cyber security teams, and delivery partners to translate business and policy requirements into robust, scalable and maintainable technical solutions. This includes architecting resilient, scalable, and operationally robust data integration solutions.

This role will be responsible (as part of a team) for designing and implementing large scale data solutions in line with a future state architecture. This role will involve producing enterprise level, fit for purpose designs and architectures, backed with deep technical knowledge of data platform engineering.

This includes architecting near-real-time and bulk data ingestion frameworks capable of processing large data volumes, mapping flat and semi-structured inputs into complex hierarchical target models, and integrating safely with downstream operational systems. Solutions are expected to be metadata and configuration-driven enabling new data sources, mapping rules, and transformation logic to be introduced without structural redesign. The role must design for idempotency, error isolation, rollback, and recovery, and apply componentised and loosely coupled architectures that allow ingestion, linkage, transformation, orchestration, and delivery layers to evolve independently. Strong emphasis is placed on operability, including monitoring, reconciliation, auditability, and enabling non-technical users to safely operate and extend the data integration processes under define governance controls.

ACCOUNTABILITIES INCLUDE

  • Design, build and maintain resilient, scalable and observable data solutions from ingestion through to automated operations
  • Implement resilient and reusable data engineering components, including validation, error handling, recovery processes and monitoring, to support operational reliability and data integrity in line with CFTP frameworks
  • Architect pipelines, ingestion processes and integration solutions to support departmental data platforms, including batch and near-real-time data flows.

Applicants must be an Australian Citizen, Permanent Resident or hold a valid work permit or visa. Work eligibility will be checked as part of the recruitment process.

Preferred candidates will be required to complete pre-employment screening, including a national police check and misconduct screening.

For more information on working with us and our recruitment process, please visit Department of Families, Fairness and Housing Victoria | Jobs (www.dffh.vic.gov.au/jobs)

Our department oversees the portfolios of housing, child protection, disability, ageing and carers, prevention of family violence, women, veterans, youth, LGBTIQA+ equality. In delivering across these portfolios, we work every day to achieve a fairer, safer and more inclusive Victoria. We support people so they can feel empowered, safe and secure.

Our department oversees the portfolios of housing, child protection, disability, ageing and carers, prevention of family violence, women, veterans, youth, LGBTIQA+ equality. In delivering across these portfolios, we work every day to achieve a fairer, safer and more inclusive Victoria. We support people so they can feel empowered, safe and secure.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Principal Data Engineer
Principal Data Engineer

Department of Families, Fairness & Housing VIC • Melbourne

On-site
AUD 150,000 - 190,000
Principal Data Engineer
Principal Data Engineer

Resources • Melbourne

On-site
AUD 170,000 - 210,000
Principal Data Engineer
Principal Data Engineer

Victorian Government - Department of Families, Fairness, and Housing • Victoria

On-site
AUD 140,000 - 210,000
Principal Service Designer
Principal Service Designer

Victorian Government - Department of Families, Fairness, and Housing • Victoria

On-site
AUD 120,000 - 160,000
Manager
Manager

Resources • Melbourne

On-site
AUD 120,000 - 150,000
Senior Project Coordinator
Senior Project Coordinator

Department of Families, Fairness & Housing VIC • Melbourne

On-site
AUD 90,000 - 120,000
Senior Project Coordinator
Senior Project Coordinator

Resources • Melbourne

On-site
AUD 85,000 - 120,000
Principal Service Designer
Principal Service Designer

Resources • Melbourne

On-site
AUD 90,000 - 120,000
Project Manager
Project Manager

Department of Families, Fairness & Housing VIC • Melbourne

On-site
AUD 120,000 - 160,000
Data Engineer
Data Engineer

Country Fire Authority • Melbourne

Hybrid
AUD 110,000 - 140,000
Meaningful Purpose
Hybrid work options
Health & wellbeing programs
+3
Top locations