Principal Developer

Department of Education; Melbourne; On-site; AUD 150,000 - 190,000; Full time

Job summary

Department of Education in Victoria is seeking a Principal Databricks Developer to lead a critical data platform migration. You will transform legacy SQL Server data warehouses and pipelines into Databricks and Azure solutions, applying your SQL and Python expertise to deliver scalable outcomes.

You will work hands-on on migration design, development, and optimisation, ensuring continuity for downstream reporting and analytics during the transition and mentoring the team to uplift Databricks

Qualifications

• Extensive experience migrating data warehouses to Databricks/Azure.
• Strong SQL and Python skills with hands-on delivery focus.
• Experience with legacy Microsoft data and BI platforms (SSIS/SSAS/SSRS).
• Ability to design, develop and optimise migration pipelines and data quality checks.

Responsibilities

• Design Databricks notebooks, jobs and workflows for data ingestion and transformation.
• Migrate SQL Server data warehouse structures and ETL processes to Databricks/Azure.
• Translate SSIS packages and pipelines to Databricks-based solutions, including Python pipelines.

Skills

Python

SQL

Databricks

Tools

Databricks

SQL Server

Azure

SSIS

SSAS

Power BI

Tableau

Job description

Lead a critical data platform migration as a Principal Databricks Developer, transforming legacy SQL Server data warehouses and pipelines into modern Databricks and Azure solutions. Apply your SQL and Python expertise to deliver scalable, high-quality outcomes.

About the Department

The department provides a wide range of learning and development support and services.

The department provides policy leadership, plans for the future of education in Victoria and leads key cross-sector collaboration. The department plays an important system steward role by providing support, guidance, oversight and assurance across early childhood and school education systems, as well as directly providing school education and 50 new early learning centres.

About the Division

The Performance and Evaluation Division (PED) collects, analyses and disseminates high-quality evidence to influence decision making across the Department, government agencies and service providers to improve outcomes for children, young people and adult learners. Within PED, the Portfolio Monitoring and Reporting team prepares whole of department reports on the implementation progress of election and in-term commitments, departmental priorities, and BP3 measures for the Secretary, Executive Board, Ministers, and central agencies.

For more details regarding this position please see attached position descriptions.

About the Role

The Principal Databricks Developer supports a critical data platform migration, transitioning an existing SQL Server data warehouse and associated pipelines to a modern Databricks and Azure environment. This role provides Databricks expertise as part of a larger project team responsible for the migration.

This role requires a highly experienced data professional with strong Databricks, SQL and python expertise, combined with a solid understanding of legacy Microsoft data and BI platforms. The successful candidate will work in a hands‑on capacity, contributing to migration design, development, and optimisation activities, while ensuring continuity for downstream reporting and analytics during the transition period.

The role is delivery‑focused, requiring the ability to rapidly understand existing systems and deliver high-quality outcomes in a complex technical environment.

Key Responsibilities

• Design and develop Databricks notebooks, jobs, and workflows using SQL and Python to support data ingestion and transformation.
• Migrate SQL Server data warehouse structures, SQL logic, and ETL processes to Databricks and Azure‑native services.
• Translate existing SSIS packages and data pipelines into scalable Databricks‑based solutions, including Python‑based pipelines where appropriate.
• Support existing reporting and semantic layers, including SSAS, SSRS, Power BI, and Tableau.
• Ensure data quality, performance, and reliability throughout the migration lifecycle.
• Ensure all code written is well‑designed, maintainable and testable.
• Support and mentor the existing team to uplift Databricks capability, promote best practices, and encourage consistent, maintainable development patterns.
• Contribute to technical documentation, testing and development standards for the new platform.

Further Information

For more details regarding this position please see attached position description for the capabilities to address in application.

The department values diversity and inclusion in all forms - gender, religion, ethnicity, LGBTIQ+, disability and neurodiversity. Aboriginal and Torres Strait Islander candidates are strongly encouraged to apply. For more information about our work, working for the Department, diversity and inclusion, and our employment conditions visit the Department website and our Diversity and Inclusion page

Applicants requiring adjustments can contact the nominated contact person.

Information about the Departme nt of Education's operations and employment conditions can be located at www.education.vic.gov.au.

For further information pertaining to the role, please contact Matthew Johnson via ***************@education.vic.gov.au.

Preferred applicants may be required to complete a police check and may be subject to other pre‑employment checks. Information provided to the Department of Education will be treated in the strictest confidence.

Please let us know via phone or email if you require adjustments to ensure your full participation in the recruitment process or if you need the ad or any attachments in an accessible format (e.g large print) due to any viewing difficulties or other accessibility requirements.

Applications close

11:59pm on 19 November 2026.