Senior Databricks Consultant / Architect

Unison Group

Singapore

Vor Ort

SGD 180.000 - 260.000

Vollzeit

Vor 4 Tagen
Sei unter den ersten Bewerbenden

Erhalte eine Antwort von diesem Arbeitgeber

Dein Lebenslauf und dein Anschreiben, genau auf das zugeschnitten, was gesucht wird.

Schaffe es an den ATS-Filtern vorbei

Zusammenfassung

Unison Group in Singapore seeks an experienced Senior Databricks Consultant/Architect to lead the design, architecture, development, and implementation of enterprise-scale data engineering and analytics solutions on Azure Databricks.

You will drive lakehouse architectures, PySpark pipelines, Delta Lake, and data governance, mentor teams, and collaborate with stakeholders to translate business needs into scalable technical solutions.

Qualifikationen

  • Strong hands‑on experience with Azure Databricks and Apache Spark.
  • ),

Aufgaben

  • Design and architect scalable, secure Lakehouse solutions using Databricks.

Kenntnisse

Azure Databricks
Apache Spark
PySpark
Delta Lake
Lakehouse architecture
Unity Catalog
Delta Live Tables
Azure Data Factory
ADLS Gen2
CI/CD
Git
Azure DevOps
Data governance

Tools

Databricks Workflows
Terraform
Docker

Jobbeschreibung

Role Overview

We are looking for an experienced Senior Databricks Consultant / Architect to lead the design, architecture, development, and implementation of enterprise-scale data engineering and analytics solutions using Azure Databricks. The ideal candidate should have strong expertise in Lakehouse architecture, PySpark, Delta Lake, cloud data platforms, and data governance.

Key Responsibilities
  • Design and architect scalable, secure, and high-performance Lakehouse solutions using Databricks.
  • Lead end-to-end data engineering and data platform implementation.
  • Define enterprise data architecture, standards, best practices, and technical roadmaps.
  • Design and implement data pipelines using PySpark, Spark SQL, Delta Lake, and Databricks Workflows.
  • Develop and optimize ETL/ELT pipelines for batch and streaming data processing.
  • Implement Medallion Architecture (Bronze, Silver, Gold) and Delta Live Tables (DLT).
  • Work extensively with Unity Catalog for data governance, security, access control, and lineage.
  • Integrate Databricks with Azure services such as ADLS Gen2, Azure Data Factory, Event Hubs, and Azure Key Vault.
  • Optimize Spark workloads, cluster configurations, SQL queries, and overall platform performance.
  • Implement CI/CD pipelines, automated deployments, and DevOps practices.
  • Provide technical leadership, conduct design reviews, and mentor data engineering teams.
  • Collaborate with business stakeholders, architects, and engineering teams to translate business requirements into technical solutions.
Mandatory Technical Skills
  • Strong hands‑on experience with Azure Databricks and Apache Spark.
  • Expertise in PySpark, Spark SQL, Python, and SQL.
  • Strong knowledge of Delta Lake and Lakehouse architecture.
  • Experience implementing Medallion Architecture.
  • Expertise in Unity Catalog, Delta Live Tables (DLT), and Auto Loader.
  • Strong understanding of ETL/ELT design and data pipeline development.
  • Experience with Azure Data Lake Storage (ADLS Gen2) and Azure Data Factory.
  • Knowledge of Databricks Workflows, cluster management, and performance tuning.
  • Experience with data security, governance, and access management.
  • Hands‑on experience with Git, Azure DevOps, and CI/CD.
Good to Have
  • Experience with AWS Databricks or GCP Databricks.
  • Knowledge of Kafka, Event Hubs, and real-time data streaming.
  • Experience with Databricks SQL and Lakehouse Monitoring.
  • Knowledge of Terraform and Infrastructure as Code.
  • Experience with MLflow and the Databricks Machine Learning ecosystem.
  • Databricks Professional‑level certifications.
Candidate Profile
  • Strong experience in enterprise data architecture and large‑scale data engineering implementations.
  • Ability to independently drive architecture decisions and technical delivery.
  • Excellent communication, stakeholder management, and problem‑solving skills.
  • Ability to work with cross‑functional teams and provide technical direction.
Hol dir deinen kostenlosen, vertraulichen Lebenslauf-Check.

oder ziehe deine Datei hierhin.

Similar jobs

Ähnliche Jobs, die dir auch gefallen könnten

Senior Databricks Lakehouse Architect | Spark & Delta Lake
Senior Databricks Lakehouse Architect | Spark & Delta Lake

Unison Group • Singapore

Vor Ort
SGD 180.000 - 280.000
Senior Databricks Solution Architect
Senior Databricks Solution Architect

Unison Group • Singapore

Vor Ort
SGD 180.000 - 280.000
Senior Data Engineer
Senior Data Engineer

optimum solutions (singapore) pte ltd • Singapore

Vor Ort
SGD 120.000 - 180.000
Senior Databricks Consultant / Architect
Senior Databricks Consultant / Architect

Hong Kong Unison Limited • Singapore

Vor Ort
SGD 180.000 - 240.000
Lead Data Architect - Databricks Lakehouse
Lead Data Architect - Databricks Lakehouse

Unison Group • Singapore

Vor Ort
SGD 180.000 - 300.000
Senior Data Engineer - #1732
Senior Data Engineer - #1732

JOBSTER PRIVATE LTD. • Singapore

Vor Ort
SGD 120.000 - 180.000
Resident Solution Architect - Databricks
Resident Solution Architect - Databricks

Unison Group • Singapore

Vor Ort
SGD 200.000 - 320.000
Data Engineer (Databricks)
Data Engineer (Databricks)

BASIL TECHNOLOGIES PTE. LTD. • Singapore

Vor Ort
SGD 90.000 - 130.000
Senior Data Engineer - Government Project
Senior Data Engineer - Government Project

NTT SINGAPORE PTE. LTD. • Singapore

Vor Ort
SGD 120.000 - 180.000
Databricks Data Engineer
Databricks Data Engineer

Unison Group • Singapore

Vor Ort
SGD 120.000 - 180.000