Databricks Data Engineer - Lakehouse & AI Solutions

Unison Group; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

Unison Group is seeking a hands-on Databricks specialist to design and operationalize Delta Lakehouse architectures. You will lead technical delivery, mentor teams, and drive real-world outcomes for enterprise customers.

The role requires strong experience with Delta Lake, DLT, Unity Catalog, SQL Warehouses, and proficiency in Python or Scala. Cloud familiarity (AWS/Azure/GCP) and DevOps/MLOps practices are essential for success.

Qualifications

• 6 to 10 years hands-on Databricks experience including workspace setup, notebooks, clusters, and job orchestration.
• Delta Lake, DLT, Unity Catalog, and SQL Warehouses expertise.
• Proficiency in Python or Scala for data engineering and ML workflows.
• Strong understanding of AWS, Azure, or GCP cloud ecosystems.
• Experience with Terraform automation, DevOps, and MLOps practices.

Responsibilities

• Design and implement scalable data pipelines using Delta Live Tables, Spark SQL, Python, or Scala.
• Optimize ETL, streaming, and ML workloads for performance, cost, and reliability.
• Administer and configure Databricks Workspaces, Unity Catalog, and cluster policies for secure environments.
• Automate infrastructure and deployments using Terraform, Git, and CI/CD pipelines.
• Implement observability and cost optimization with tools like Splunk, Prometheus, or CloudWatch.
• Collaborate with customers to build AI/LLM solutions leveraging MLflow, DBRX, and Mosaic AI.

Skills

Databricks

Delta Lake

DLT

Unity Catalog

Python

Scala

Cloud platforms (AWS/Azure/GCP)

Terraform

DevOps

MLOps

MLflow

Tools

Terraform

Git

CI/CD

Splunk

Prometheus

CloudWatch

DBRX

Mosaic AI

Job description

Unison Group is seeking a hands-on Databricks specialist to design and operationalize Delta Lakehouse architectures. You will lead technical delivery, mentor teams, and drive real-world outcomes for enterprise customers.

The role requires strong experience with Delta Lake, DLT, Unity Catalog, SQL Warehouses, and proficiency in Python or Scala. Cloud familiarity (AWS/Azure/GCP) and DevOps/MLOps practices are essential for success.