Databricks Principal Engineer — Azure Migration Lead

Department of Education Victoria; Melbourne; On-site; AUD 100,000 - 150,000; Full time

Job summary

Department of Education Victoria in Melbourne is seeking a Principal Databricks Developer to lead the migration of a SQL Server data warehouse to Databricks and Azure. You will design notebooks, migrate pipelines, and optimize data flows while ensuring reporting continuity with SSAS, SSRS, Power BI and Tableau.

The role demands deep Databricks, SQL and Python expertise and a proactive, hands-on delivery style in a complex environment.

Qualifications

• Experience with Databricks, SQL and Python in data migration projects.
• Strong understanding of legacy Microsoft data and BI platforms.
• Delivery-focused, hands-on experience in complex data environments.

Responsibilities

• Design and develop Databricks notebooks, jobs and workflows using SQL and Python.
• Migrate SQL Server data warehouse structures, logic and ETL to Databricks and Azure services.
• Translate SSIS packages and pipelines to scalable Databricks-based solutions.
• Support reporting layers including SSAS, SSRS, Power BI and Tableau.
• Ensure data quality, performance and reliability throughout migration.
• Write well-structured, maintainable and testable code.
• Mentor the team to uplift Databricks capability and best practices.
• Contribute to technical documentation and development standards.

Skills

Databricks

SQL

Python

Legacy BI platforms

Tools

SSIS

Power BI

Tableau

Azure services

Job description

Department of Education Victoria in Melbourne is seeking a Principal Databricks Developer to lead the migration of a SQL Server data warehouse to Databricks and Azure. You will design notebooks, migrate pipelines, and optimize data flows while ensuring reporting continuity with SSAS, SSRS, Power BI and Tableau.

The role demands deep Databricks, SQL and Python expertise and a proactive, hands-on delivery style in a complex environment.