Azure Databricks Architect - Lakehouse Leader

UNISON Group

Singapore

On-site

SGD 200,000 - 280,000

Full time

9 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

UNISON Group in Singapore seeks an experienced Senior Databricks Consultant/Architect to lead design, architecture, development, and implementation of enterprise-scale data engineering and analytics using Azure Databricks.

You will define data architecture, build scalable pipelines with PySpark, Delta Lake, and Delta Live Tables, work with Unity Catalog, and collaborate with stakeholders to translate business needs into technical solutions while guiding teams through CI/CD and DevOps practices.

Qualifications

  • Strong hands-on experience with Azure Databricks and Apache Spark.
  • Expertise in PySpark, Spark SQL, Python, and SQL.
  • Strong knowledge of Delta Lake and Lakehouse architecture.
  • Experience implementing Medallion Architecture.
  • Expertise in Unity Catalog, Delta Live Tables (DLT), and Auto Loader.
  • Strong understanding of ETL/ELT design and data pipeline development.
  • Experience with Azure Data Lake Storage (ADLS Gen2) and Azure Data Factory.
  • Knowledge of Databricks Workflows, cluster management, and performance tuning.
  • Experience with data security, governance, and access management.
  • Hands-on experience with Git, Azure DevOps, and CI/CD.

Responsibilities

  • Design and architect scalable, secure, and high-performance Lakehouse solutions using Databricks.
  • Lead end-to-end data engineering and data platform implementation.
  • Define enterprise data architecture, standards, best practices, and technical roadmaps.
  • Design and implement data pipelines using PySpark, Spark SQL, Delta Lake, and Databricks Workflows.
  • Develop and optimize ETL/ELT pipelines for batch and streaming data processing.
  • Implement Medallion Architecture (Bronze, Silver, Gold) and Delta Live Tables (DLT).
  • Work extensively with Unity Catalog for data governance, security, access control, and lineage.
  • Integrate Databricks with Azure services such as ADLS Gen2, Azure Data Factory, Event Hubs, and Azure Key Vault.
  • Optimize Spark workloads, cluster configurations, SQL queries, and overall platform performance.
  • Implement CI/CD pipelines, automated deployments, and DevOps practices.
  • Provide technical leadership, conduct design reviews, and mentor data engineering teams.
  • Collaborate with business stakeholders, architects, and engineering teams to translate business requirements into technical solutions.

Skills

Azure Databricks
Apache Spark
PySpark
Delta Lake
Lakehouse architecture
Unity Catalog
Delta Live Tables
ADLS Gen2
Azure Data Factory
Git / CI-CD

Tools

Databricks Workflows
Delta Live Tables
Unity Catalog
Terraform

Job description

UNISON Group in Singapore seeks an experienced Senior Databricks Consultant/Architect to lead design, architecture, development, and implementation of enterprise-scale data engineering and analytics using Azure Databricks.

You will define data architecture, build scalable pipelines with PySpark, Delta Lake, and Delta Live Tables, work with Unity Catalog, and collaborate with stakeholders to translate business needs into technical solutions while guiding teams through CI/CD and DevOps practices.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Azure Databricks Architect | Lakehouse & Data Platform Lead
Azure Databricks Architect | Lakehouse & Data Platform Lead

Hong Kong Unison Limited • Singapore

On-site
SGD 180,000 - 240,000
Senior Databricks Consultant / Architect
Senior Databricks Consultant / Architect

Hong Kong Unison Limited • Singapore

On-site
SGD 180,000 - 240,000
Senior Databricks Data Architect & AI Solutions Lead
Senior Databricks Data Architect & AI Solutions Lead

Hong Kong Unison Limited • Singapore

On-site
SGD 180,000 - 280,000
Lead Databricks Data Architect - AI, Migrations & Lakehouse
Lead Databricks Data Architect - AI, Migrations & Lakehouse

Unison Group • Singapore

On-site
SGD 180,000 - 260,000
Databricks Data Engineer - Lakehouse & AI Solutions
Databricks Data Engineer - Lakehouse & AI Solutions

Unison Group • Singapore

On-site
SGD 120,000 - 180,000
Senior Lakehouse Solutions Architect - Data & AI
Senior Lakehouse Solutions Architect - Data & AI

Databricks Inc. • Singapore

On-site
SGD 120,000 - 150,000
Comprehensive benefits package
Lead Databricks Solution Architect: Data & AI Platform
Lead Databricks Solution Architect: Data & AI Platform

Unison Group • Singapore

On-site
SGD 200,000 - 320,000
Resident Solution Architect - Databricks
Resident Solution Architect - Databricks

UNISON Group • Singapore

On-site
SGD 200,000 - 280,000
Databricks Data Architect
Databricks Data Architect

Hong Kong Unison Limited • Singapore

On-site
SGD 180,000 - 280,000
Data Engineer: Databricks, PySpark & Delta Lake
Data Engineer: Databricks, PySpark & Delta Lake

Espire Infolabs • Singapore

On-site
SGD 70,000 - 110,000