Lead Data Engineer - Databricks on Azure, AI-Ready Data

Morgan Consulting Idibu; Melbourne; Presencial; AUD 162.000 - 198.000; Jornada completa

Descripción de la vacante

Morgan Consulting is partnering with a fast growing Melbourne-based organisation to hire a Lead Data Engineer specializing in Databricks on Azure. You will lead and hands-on build data pipelines, support enterprise BI, analytics, and AI initiatives in a retail data landscape.

You will work across platform, analytics enablement, BI delivery, production support, DevOps and governance, collaborating with stakeholders to produce robust, scalable lakehouse solutions and trusted production-ready

Formación

• Hands-on experience building Databricks lakehouse solutions on Azure.
• Proficient in PySpark, SQL, and Python for data pipelines.
• Experience with BI and AI workloads in enterprise settings.
• Strong stakeholder collaboration and production support skills.
• Knowledge of data governance, security, and DevOps practices.

Responsabilidades

• Deliver scalable data solutions for BI, analytics, and AI use cases.
• Develop data pipelines with Databricks, ADF, and ADLS.
• Design and maintain curated data models for analytics and AI.
• Develop Power BI datasets and semantic models.
• Implement CI/CD, security, and governance across data platforms.
• Balance project work with BAU in retail data landscape.

Conocimientos

Databricks

PySpark

Python

SQL

Azure Databricks

Delta Lake

Unity Catalog

Genie AI

Power BI

Herramientas

Azure Data Factory

Azure Data Lake Storage

Power BI Service

Azure DevOps

Source Control

CI/CD

Descripción del empleo

Morgan Consulting is partnering with a fast growing Melbourne-based organisation to hire a Lead Data Engineer specializing in Databricks on Azure. You will lead and hands-on build data pipelines, support enterprise BI, analytics, and AI initiatives in a retail data landscape.

You will work across platform, analytics enablement, BI delivery, production support, DevOps and governance, collaborating with stakeholders to produce robust, scalable lakehouse solutions and trusted production-ready