Senior Data Lakehouse Architect - Azure Databricks

Showtime Consulting Pty Ltd; Canberra; On-site; AUD 150,000 - 210,000; Full time

Job summary

Showtime Consulting Pty Ltd is seeking an experienced Senior Data Engineer / Data Architect to join our high‑performing data and cloud engineering team. You will design and deliver enterprise Data Lakehouse solutions on Azure Databricks, modernising legacy platforms and enabling cloud-first analytics across business units.

The role requires deep expertise in PySpark, Delta Lake, Azure Data Services, and data governance, with a track record of large-scale data transformations.

Qualifications

• Experience as a Data Engineer, Data Architect, or similar role.
• Strong hands-on experience with Azure Databricks.
• Expertise with PySpark, Spark SQL, and Delta Lake.
• Experience with Azure Data Factory (ADF), ADLS, and Azure Synapse Analytics.
• Strong data modelling experience, including Dimensional Modelling and Data Vault.
• Deep understanding of data governance, data architecture, security, and data quality.
• Experience delivering real-time and streaming data solutions.
• Strong Azure cloud platform experience.
• Experience with Git, CI/CD, and DevOps practices.
• Excellent stakeholder engagement and communication skills.

Responsibilities

• Design and implement enterprise Data Lakehouse solutions using Azure Databricks.
• Lead data modernisation and cloud migration initiatives.
• Build scalable batch and real-time data processing solutions.
• Develop and maintain data pipelines using PySpark and Spark SQL.
• Define data governance, security, lineage, and data quality standards.
• Design dimensional and Data Vault data models.
• Collaborate with business and technology stakeholders to deliver strategic data platforms.
• Drive data architecture standards, governance, and technical governance.
• Implement CI/CD and DevOps across data engineering workloads.
• Provide technical leadership and mentor engineering teams.

Skills

Azure Databricks

PySpark

Spark SQL

Delta Lake

Azure Data Factory

Azure Synapse

Data Governance

Data Modeling

Real-time processing

Git

CI/CD

DevOps

Tools

Git

Job description

Showtime Consulting Pty Ltd is seeking an experienced Senior Data Engineer / Data Architect to join our high‑performing data and cloud engineering team. You will design and deliver enterprise Data Lakehouse solutions on Azure Databricks, modernising legacy platforms and enabling cloud-first analytics across business units.

The role requires deep expertise in PySpark, Delta Lake, Azure Data Services, and data governance, with a track record of large-scale data transformations.