Secure Cloud Data Architect — Databricks & Lakehouse

Showtime Consulting Pty Ltd; Australia; Hybrid; AUD 140,000 - 210,000; Full time

Job summary

Showtime Consulting is seeking a Senior Data Engineer / Data Architect to join our high-performing data and cloud engineering team in Australia. The role focuses on enterprise Data Lakehouse projects using Azure Databricks and modern data platforms to enable analytics and reporting.

You will define data architecture, govern data quality, and mentor engineers while collaborating with stakeholders to deliver cloud-first data platforms that support ML, compliance, and operational workloads.

Qualifications

• Extensive experience as a Data Engineer or Data Architect in enterprise environments.
• Deep expertise with Azure Databricks, PySpark, and Delta Lake.
• Proven ability to design scalable Data Lakehouse architectures and data pipelines.
• Strong knowledge of governance, security, and data quality standards.
• Experience with Azure data services (ADF, ADLS, Synapse) and data modeling.
• Excellent communication and stakeholder engagement skills.
• Experience mentoring engineering teams.

Responsibilities

• Design and implement enterprise Data Lakehouse solutions using Azure Databricks.
• Lead data modernization and cloud migration initiatives.
• Build scalable batch and real-time data processing solutions.
• Develop and maintain data pipelines using PySpark and Spark SQL.
• Define data governance, security, lineage, and data quality standards.
• Design dimensional and Data Vault data models.
• Collaborate with business and technology stakeholders to deliver strategic data platforms.
• Drive data architecture standards, best practices, and technical governance.
• Implement CI/CD and DevOps practices across data engineering workloads.
• Provide technical leadership and mentor engineering teams.

Skills

Azure Databricks

PySpark

Delta Lake

Spark SQL

Azure Data Factory

ADLS

Azure Synapse Analytics

Data Modeling (Dimensional/Data Vault)

Data Governance

CI/CD & DevOps

Git

Stakeholder Engagement

Leadership/Mentoring

Tools

Git

CI/CD

Job description

Showtime Consulting is seeking a Senior Data Engineer / Data Architect to join our high-performing data and cloud engineering team in Australia. The role focuses on enterprise Data Lakehouse projects using Azure Databricks and modern data platforms to enable analytics and reporting.

You will define data architecture, govern data quality, and mentor engineers while collaborating with stakeholders to deliver cloud-first data platforms that support ML, compliance, and operational workloads.