Senior Databricks Solution Architect

Unison Group New Zealand; Singapore; On-site; SGD 150,000 - 210,000; Full time

Job summary

Unison Group New Zealand seeks an experienced Senior Databricks Solution Architect to design enterprise-scale Databricks Lakehouse architectures and lead implementation initiatives. You will provide technical leadership for modern data platforms, focusing on security, governance, and scalable pipelines.

Ideal candidates will have deep expertise in Databricks, Delta Lake, Apache Spark, and cloud data platforms, with a track record of guiding governance, data quality, and architecture discussions

Qualifications

• Strong hands-on experience with Databricks architecture, Apache Spark, PySpark, SQL, Delta Lake, and Lakehouse architecture.
• Proven experience designing and delivering enterprise-scale Databricks solutions.
• Strong understanding of data engineering, ETL/ELT, data modeling, and cloud data platforms (Azure / AWS / GCP).

Responsibilities

• Design and architect Databricks Lakehouse solutions for enterprise data platforms.
• Define Databricks architecture, including workspace design, cluster strategy, security model, governance, and operational standards.
• Design and implement Delta Lake architectures including Delta tables, Medallion Architecture (Bronze/Silver/Gold), data quality frameworks, schema evolution, and optimization.
• Architect scalable data pipelines using Databricks, Apache Spark, PySpark, SQL, and ETL/ELT frameworks.
• Lead end-to-end Databricks implementation, migration, deployment, performance tuning, and cost optimization.
• Implement enterprise data governance using Unity Catalog, access controls, data lineage, and audit capabilities.
• Provide architecture guidance, technical documentation, and lead design discussions with enterprise stakeholders.

Skills

Databricks arch

Apache Spark

PySpark

SQL

Delta Lake

Lakehouse

Data governance

CI/CD

Workflows

Tools

Databricks Workflows

Notebooks

Repos

Cluster management

Job description

We are seeking an experienced Senior Databricks Solution Architect to design enterprise-scale Databricks Lakehouse architectures, lead implementation initiatives, and provide technical leadership for modern data platforms. The ideal candidate will have strong expertise in Databricks architecture, Delta Lake, Apache Spark, cloud data platforms, data governance, and enterprise solution design.

Key Responsibilities

• Design and architect Databricks Lakehouse solutions for enterprise data platforms.
• Define Databricks architecture, including workspace design, cluster strategy, security model, governance, and operational standards.
• Design and implement Delta Lake architectures including Delta tables, Medallion Architecture (Bronze/Silver/Gold), data quality frameworks, schema evolution, and optimization.
• Architect scalable data pipelines using Databricks, Apache Spark, PySpark, SQL, and ETL/ELT frameworks.
• Lead end-to-end Databricks implementation, migration, deployment, performance tuning, and cost optimization.
• Implement enterprise data governance using Unity Catalog, access controls, data lineage, and audit capabilities.
• Provide architecture guidance, technical documentation, and lead design discussions with enterprise stakeholders.

Required Skills

• Strong hands-on experience with Databricks architecture, Apache Spark, PySpark, SQL, Delta Lake, and Lakehouse architecture.
• Proven experience designing and delivering enterprise-scale Databricks solutions.
• Strong understanding of data engineering, ETL/ELT, data modeling, and cloud data platforms (Azure / AWS / GCP).
• Experience with Databricks Workflows, Jobs, Notebooks, Repos, cluster management, and CI/CD practices.
• Strong troubleshooting, performance optimization, and solution design skills.

Preferred Skills

• Experience with MLflow, MLOps, Structured Streaming, Kafka, and enterprise data governance.
• Experience supporting AI/ML workloads on Databricks.

Experience Profile

• Experience in data engineering, data architecture, or solution architecture.
• Hands-on experience designing and delivering Databricks solutions.
• Experience leading enterprise data platform modernization and Lakehouse transformation projects.