Principal Data Engineer

Victorian Government - Department of Families, Fairness, and Housing

Victoria

On-site

AUD 140,000 - 210,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

The Victorian Government - Department of Families, Fairness and Housing seeks a Principal Data Engineer to lead design, development and deployment of a modern enterprise data platform centred on Databricks.

You will work with solution architects, cyber security teams and delivery partners to translate policy requirements into scalable data solutions, with strong emphasis on governance, security and operability.

Responsibilities

  • Design, develop and implement a modern enterprise data platform centred on Databricks.
  • Translate business and policy requirements into robust, scalable data solutions.
  • Lead complex data engineering work of high strategic importance and risk.
  • Ensure operability, monitoring, auditability and governance across data solutions.

Job description

THE ROLEThe Communities and Families Transformation Program (CFTP) is a large-scale service transformation program that will replace legacy case management systems and deliver modern tools to approximately 10,000 users across nine program areas in the Department of Families, Fairness and Housing (DFFH) and the Department of Justice and Community Safety (DJCS). The program will also deliver improved case management and reporting capabilities to Community Sector Organisations (CSOs) and Aboriginally Controlled Community Organisations (ACCOs). The program will redesign how services are delivered to improve efficiency and outcomes while enhancing compliance and data privacy and security.The first tranche of work, spanning three years, has been funded by government and will deliver: replacement of IRIS (the legacy sector reporting system); service design for Child Protection; complete foundational technology design and build; and procurement.Reporting to the Chief Architect, the Principal Data Engineer is responsible for the design, development, and implementation of a modern enterprise data platform, centred on Databricks and aligned with Victorian Government digital, data, and cloud strategies. The role will provide technical expertise across data engineering, data architecture, solution architecture, and complex data migration.The role leads complex technical work of high strategic importance and risk, translating whole-of-organisation data and analytics objectives into robust, secure, and scalable platform solutions. It operates with a high degree of autonomy and professional judgement and is recognised as a subject matter expert across data platform architecture.The role works closely with solution architects, business subject matter experts, cyber security teams, and delivery partners to translate business and policy requirements into robust, scalable and maintainable technical solutions. This includes architecting resilient, scalable, and operationally robust data integration solutions.This role will be responsible (as part of a team) for designing and implementing large scale data solutions in line with a future state architecture. This role will involve producing enterprise level, fit for purpose designs and architectures, backed with deep technical knowledge of data platform engineering.This includes architecting near-real-time and bulk data ingestion frameworks capable of processing large data volumes, mapping flat and semi-structured inputs into complex hierarchical target models, and integrating safely with downstream operational systems. Solutions are expected to be metadata and configuration-driven enabling new data sources, mapping rules, and transformation logic to be introduced without structural redesign. The role must design for idempotency, error isolation, rollback, and recovery, and apply componentised and loosely coupled architectures that allow ingestion, linkage, transformation, orchestration, and delivery layers to evolve independently. Strong emphasis is placed on operability, including monitoring, reconciliation, auditability, and enabling non-technical users to safely operate and extend the data integration processes under define governance controls.ACCOUNTABILITIES INCLUDEDesign, build and maintain resilient, scalable and observable data solutions from ingestion through to automated operationsImplement resilient and reusable data engineering components, including validation, error handling, recovery processes and monitoring, to support operational reliability and data integrity in line with CFTP frameworksArchitect pipelines, ingestion processes and integration solutions to support departmental data platforms, including batch and near-real-time data flows.Please open the position description to read more.HOW TO APPLYApplicants are encouraged to apply online. Attachments can be uploaded in .doc, .docx, .pdf, .txt or .rtf formats.Applicants are required to submit a CV and Cover Letter (max 2 pages) outlining their suitability to the role in line with the Key Selection Criteria.Applicants must be an Australian Citizen, Permanent Resident or hold a valid work permit or visa. Work eligibility will be checked as part of the recruitment process.Preferred candidates will be required to complete pre-employment screening, including a national police check and misconduct screening.For more information on working with us and our recruitment process, please visit Department of Families, Fairness and Housing Victoria | Jobs (www.dffh.vic.gov.au/jobs)Please apply to submit your interest in this position.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Principal Data Engineer
Principal Data Engineer

Department of Families, Fairness & Housing VIC • Melbourne

On-site
AUD 150,000 - 190,000
Principal Data Engineer
Principal Data Engineer

Department of Families, Fairness & Housing • Melbourne

On-site
AUD 143,000 - 191,000
Principal Data Engineer
Principal Data Engineer

Resources • Melbourne

On-site
AUD 170,000 - 210,000
Principal Service Designer
Principal Service Designer

Victorian Government - Department of Families, Fairness, and Housing • Victoria

On-site
AUD 120,000 - 160,000
Project Manager
Project Manager

Victorian Government - Department of Families, Fairness, and Housing • Victoria

On-site
AUD 100,000 - 160,000
Senior Project Coordinator
Senior Project Coordinator

Victorian Government - Department of Families, Fairness, and Housing • Victoria

On-site
AUD 100,000 - 130,000
Senior Project Coordinator
Senior Project Coordinator

Department of Families, Fairness & Housing VIC • Melbourne

On-site
AUD 90,000 - 120,000
Senior Project Coordinator
Senior Project Coordinator

Resources • Melbourne

On-site
AUD 85,000 - 120,000
Manager Data Systems and Support
Manager Data Systems and Support

Victorian Government - Department of Health • Victoria

On-site
AUD 140,000 - 180,000
Principal Service Designer
Principal Service Designer

Resources • Melbourne

On-site
AUD 90,000 - 120,000
Top locations