Senior Databricks Lakehouse Architect | Cloud Data Platform

Kaliba; Sydney; On-site; AUD 180,000 - 240,000; Full time

Job summary

Kaliba in Sydney seeks a Senior Databricks Solution Architect to design and deliver enterprise Databricks Lakehouse platforms, lead complex implementations and provide technical direction across major data modernization initiatives.

You will combine hands-on Databricks, Spark and cloud data platform expertise with strong solution design and stakeholder-management skills to drive scalable, secure, and cost-efficient data platforms for enterprise clients.

Qualifications

• Strong hands-on Databricks architecture experience.
• Proven delivery of enterprise-scale Databricks solutions.
• Deep knowledge of Apache Spark, PySpark, SQL and Delta Lake.
• Strong understanding of Lakehouse and Medallion architecture.
• Experience with enterprise ETL/ELT, data modelling and data engineering.
• Azure, AWS or Google Cloud data-platform experience.
• Knowledge of Databricks Workflows, Jobs, Notebooks, Repos and cluster management.
• Experience implementing CI/CD practices for modern data platforms.
• Strong troubleshooting, performance-tuning and cost-optimisation skills.
• Excellent solution-design, documentation and stakeholder-management capability.

Responsibilities

• Designing enterprise Databricks Lakehouse solutions.
• Defining workspace architecture, cluster strategy, security models and operational standards.
• Designing Delta Lake and Medallion architectures across Bronze, Silver and Gold layers.
• Architecting scalable data pipelines using Databricks, Apache Spark, PySpark and SQL.
• Leading Databricks implementations, migrations and production deployments.
• Improving platform performance, reliability and cost efficiency.
• Establishing data-quality frameworks and schema-evolution strategies.
• Implementing governance through Unity Catalog, access controls, lineage and auditing.
• Producing architecture documentation and leading technical design discussions.
• Working with engineering teams and enterprise stakeholders throughout delivery.

Skills

Databricks architecture

Enterprise Databricks deployments

Apache Spark

PySpark

SQL

Delta Lake

Lakehouse/Medallion architecture

ETL/ELT

Data modelling

Cloud platforms (Azure/AWS/GCP)

CI/CD for data platforms

Performance tuning

Stakeholder management

Job description

Kaliba in Sydney seeks a Senior Databricks Solution Architect to design and deliver enterprise Databricks Lakehouse platforms, lead complex implementations and provide technical direction across major data modernization initiatives.

You will combine hands-on Databricks, Spark and cloud data platform expertise with strong solution design and stakeholder-management skills to drive scalable, secure, and cost-efficient data platforms for enterprise clients.