Databricks Lakehouse Engineer – Frontline Data Solutions

Argyll Scott Singapore; Malaysia; On-site; MYR 167,000 - 246,000; Full time

Job summary

Argyll Scott Asia is hiring four Forward Deployed Data Engineers to join a large financial services data transformation programme in Kuala Lumpur. The role sits between business/Finance stakeholders and engineering teams, building and productionising Databricks lakehouse data products.

You will design production-grade data pipelines using Databricks, Spark, SQL and Python, implement medallion datasets, and apply CI/CD with governance.

Qualifications

• 3-10 years' experience across data engineering or related roles.
• Hands-on with Databricks, Spark, SQL and Python.
• Understanding Delta Lake and medallion architecture in lakehouse environments.
• Experience with Azure and/or Google Cloud.
• Strong stakeholder-facing skills and ability to bridge technical and business teams.

Responsibilities

• Design production-grade data pipelines and data products using Databricks, Spark, SQL, Python and Delta Lake.
• Develop governed Bronze, Silver and Gold datasets using medallion architecture.
• Work with Finance and stakeholders to translate reporting requirements into scalable data solutions.
• Integrate data across Azure, Google Cloud, APIs, databases and enterprise platforms.
• Implement data governance and controls using Unity Catalog, lineage and data quality frameworks.
• Support Databricks Genie / AI-BI Genie implementations and self-service analytics use cases.
• Apply CI/CD, monitoring and DevOps practices to ensure production readiness.

Skills

Data engineering

Stakeholder communication

Consulting experience

Tools

Databricks

Spark

SQL

Python

Delta Lake

Azure

Google Cloud

Job description

Argyll Scott Asia is hiring four Forward Deployed Data Engineers to join a large financial services data transformation programme in Kuala Lumpur. The role sits between business/Finance stakeholders and engineering teams, building and productionising Databricks lakehouse data products.

You will design production-grade data pipelines using Databricks, Spark, SQL and Python, implement medallion datasets, and apply CI/CD with governance.