Databricks Lakehouse Architect | AI & Data Lead

Hong Kong Unison Limited; Singapore; On-site; SGD 180,000 - 260,000; Full time

Job summary

Unison Consulting in Singapore is seeking a hands-on Solutions Architect with deep Databricks expertise to design and operationalize Delta Lakehouse architectures for enterprise clients.

You will own end-to-end delivery, optimize ETL/ML workloads, and guide engineering teams on data governance, security, and scalable architectures across AWS/Azure/GCP.

Collaborate with customers to translate business needs into robust data lakehouse solutions and drive measurable outcomes.

Qualifications

• 10+ hands-on Databricks experience including workspace setup, notebooks, clusters, and job orchestration.
• Expertise in Delta Lake, DLT, Unity Catalog, and SQL Warehouses.
• 8+ years of experience with Spark.
• Proficiency in Python or Scala for data engineering and ML workflows.
• Strong understanding of AWS, Azure, or GCP cloud ecosystems.
• Experience with Terraform automation, DevOps, and MLOps practices.
• Familiarity with monitoring and governance frameworks for large-scale data platforms.

Responsibilities

• Design and implement scalable data pipelines using Delta Live Tables, Spark SQL, Python, or Scala.
• Optimize ETL, streaming, and ML workloads for performance, cost efficiency, and reliability.
• Administer and configure Databricks Workspaces, Unity Catalog, and cluster policies for secure, governed environments.
• Automate infrastructure and deployments using Terraform, Git, and CI/CD pipelines.
• Implement observability, cost optimization, and monitoring frameworks using tools like Splunk, Prometheus, or CloudWatch.
• Collaborate with customers to build AI and LLM solutions leveraging MLflow, DBRX, and Mosaic AI.

Skills

Databricks

Delta Lake/DLT/Unity Catalog

Spark

Python/Scala

Cloud ecosystems (AWS/Azure/GCP)

Terraform/DevOps

Monitoring/Governance

Tools

Terraform

MLflow

Job description

Unison Consulting in Singapore is seeking a hands-on Solutions Architect with deep Databricks expertise to design and operationalize Delta Lakehouse architectures for enterprise clients.

You will own end-to-end delivery, optimize ETL/ML workloads, and guide engineering teams on data governance, security, and scalable architectures across AWS/Azure/GCP.

Collaborate with customers to translate business needs into robust data lakehouse solutions and drive measurable outcomes.