Principal Developer

Department of Education Victoria; Melbourne; On-site; AUD 100,000 - 150,000; Full time

Job summary

Department of Education Victoria in Melbourne is seeking a Principal Databricks Developer to lead the migration of a SQL Server data warehouse to Databricks and Azure. You will design notebooks, migrate pipelines, and optimize data flows while ensuring reporting continuity with SSAS, SSRS, Power BI and Tableau.

The role demands deep Databricks, SQL and Python expertise and a proactive, hands-on delivery style in a complex environment.

Qualifications

• Experience with Databricks, SQL and Python in data migration projects.
• Strong understanding of legacy Microsoft data and BI platforms.
• Delivery-focused, hands-on experience in complex data environments.

Responsibilities

• Design and develop Databricks notebooks, jobs and workflows using SQL and Python.
• Migrate SQL Server data warehouse structures, logic and ETL to Databricks and Azure services.
• Translate SSIS packages and pipelines to scalable Databricks-based solutions.
• Support reporting layers including SSAS, SSRS, Power BI and Tableau.
• Ensure data quality, performance and reliability throughout migration.
• Write well-structured, maintainable and testable code.
• Mentor the team to uplift Databricks capability and best practices.
• Contribute to technical documentation and development standards.

Skills

Databricks

SQL

Python

Legacy BI platforms

Tools

SSIS

Power BI

Tableau

Azure services

Job description

Department of Education Victoria – Melbourne VIC

The department provides a wide range of learning and development support and services.

The department provides policy leadership, plans for the future of education in Victoria and leads key cross-sector collaboration. The department plays an important system steward role by providing support, guidance, oversight and assurance across early childhood and school education systems, as well as directly providing school education and 50 new early learning centres.

About the Division

The Performance and Evaluation Division (PED) collects, analyses and disseminates high-quality evidence to influence decision making across the Department, government agencies and service providers to improve outcomes for children, young people and adult learners. Within PED, the Portfolio Monitoring and Reporting team prepares whole of department reports on the implementation progress of election and in-term commitments, departmental priorities, and BP3 measures for the Secretary, Executive Board, Ministers, and central agencies.

For more details regarding this position please see attached position descriptions.

About the Role

The Principal Databricks Developer supports a critical data platform migration, transitioning an existing SQL Server data warehouse and associated pipelines to a modern Databricks and Azure environment. This role provides Databricks expertise as part of a larger project team responsible for the migration.

This role requires a highly experienced data professional with strong Databricks, SQL and python expertise, combined with a solid understanding of legacy Microsoft data and BI platforms. The successful candidate will work in a hands-on capacity, contributing to migration design, development, and optimisation activities, while ensuring continuity for downstream reporting and analytics during the transition period.

The role is delivery-focused, requiring the ability to rapidly understand existing systems and deliver high-quality outcomes in a complex technical environment.

Key Responsibilities

• Design and develop Databricks notebooks, jobs, and workflows using SQL and Python to support data ingestion and transformation.
• Migrate SQL Server data warehouse structures, SQL logic, and ETL processes to Databricks and Azure-native services.
• Translate existing SSIS packages and data pipelines into scalable Databricks-based solutions, including Python-based pipelines where appropriate.
• Support existing reporting and semantic layers, including SSAS, SSRS, Power BI, and Tableau.
• Ensure data quality, performance, and reliability throughout the migration lifecycle.
• Ensure all code written is well-designed, maintainable and testable.
• Support and mentor the existing team to uplift Databricks capability, promote best practices, and encourage consistent, maintainable development patterns.
• Contribute to technical documentation, testing and development standards for the new platform.

Further Information

For more details regarding this position please see attached position description for the capabilities to address in application.

The department values diversity and inclusion in all forms - gender, religion, ethnicity, LGBTIQ+, disability and neurodiversity. Aboriginal and Torres Strait Islander candidates are strongly encouraged to apply. For more information about our work, working for the Department, diversity and inclusion, and our employment conditions visit the Department website and our Diversity and Inclusion page

Applicants requiring adjustments can contact the nominated contact person.

Information about the Department of Education's operations and employment conditions can be located at www.education.vic.gov.au.

For further information pertaining to the role, please contact Matthew Johnson via ***************@education.vic.gov.au.

Preferred applicants may be required to complete a police check and may be subject to other pre-employment checks. Information provided to the Department of Education will be treated in the strictest confidence.

Please let us know via phone or email if you require any adjustments to ensure your full participation in the recruitment process or if you need the ad or any attachments in an accessible format (e.g large print) due to any viewing difficulties or other accessibility requirements.