Databricks ML Lead: Senior Data Architect & MLOps

AVANADE ASIA PTE LTD; Kuala Lumpur; On-site; MYR 120,000 - 180,000; Full time

Job summary

A leading technology consultancy based in Kuala Lumpur is seeking a Databricks M/L Technical Lead. This senior role involves designing, developing, and delivering scalable data solutions on the Databricks Lakehouse Platform. Candidates should have a strong background in Python and PySpark/Scala, with at least 8 years of experience in machine learning and specific expertise in Databricks. The role emphasizes performance optimization and defining coding standards within a team environment.

Qualifications

• 8+ years of experience in machine learning, data science, or MLOps.
• 4+ years of experience on the Databricks Lakehouse Platform.
• Expert proficiency in Python and PySpark/Scala.
• Deep understanding of Delta Lake architecture.

Responsibilities

• Define and implement robust data architectures using Databricks.
• Write high‑quality code in PySpark/Scala and SQL for ETL/ELT pipelines.
• Lead performance tuning for large‑scale Spark jobs.
• Define and enforce technical standards and best practices.

Skills

Machine learning

Data science

MLOps

Python

PySpark

Scala

Tools

Databricks Lakehouse Platform

MLflow

Delta Lake

Terraform

Kafka

Job description

A leading technology consultancy based in Kuala Lumpur is seeking a Databricks M/L Technical Lead. This senior role involves designing, developing, and delivering scalable data solutions on the Databricks Lakehouse Platform. Candidates should have a strong background in Python and PySpark/Scala, with at least 8 years of experience in machine learning and specific expertise in Databricks. The role emphasizes performance optimization and defining coding standards within a team environment.