Azure Data Engineer for AI-Driven Platform

K3 Advisory Group; Kuala Lumpur; Hybrid; MYR 120,000 - 180,000; Full time

Job summary

K3 Advisory Group in Kuala Lumpur is seeking a Data Engineer to build and maintain ELT pipelines, data models and data products powering analytics and AI across its brands. You will work under the Data Lead, delivering secure, auditable data assets for advisors and clients.

Responsibilities include designing pipelines, schemas, API integrations, and governance controls, while collaborating with UK-based stakeholders across time zones in a regulated professional services environment.

Qualifications

• 4+ years in modern data engineering with cloud platforms, ideally Azure.
• Strong SQL including PostgreSQL and Python (or Scala) for data transformation.
• Experience with Azure data services such as Data Factory, Fabric, Synapse or Databricks.
• Solid experience working with APIs: consuming them reliably at scale and exposing data through them.
• Experience with data transformations, reconciliation and version-controlled ETL/ELT pipeline development with CI/CD.
• Working knowledge of star schema and medallion/lakehouse modelling.
• Data governance awareness and practical PII handling experience.
• Able to communicate clearly with UK-based stakeholders and work across time zones.

Responsibilities

• Develop ELT pipelines from SaaS, ERP, CRM and finance systems into the Azure data platform (Azure Data Lake, Synapse/Databricks, PostgreSQL).
• Design and implement data models (star schema and medallion/lakehouse patterns) with semantic layers for product, dashboard and AI consumption.
• Implement transformations using SQL and Python within version-controlled, code-reviewed workflows.
• Manage schema evolution and change data capture (CDC) so downstream models remain stable as source systems change.
• Optimise pipeline and query performance — including PostgreSQL tuning — balancing cost, freshness and reliability.
• Build robust API integrations to ingest data from third-party and internal systems.
• Expose governed datasets to third-party systems and internal products via APIs and approved data views.
• Contribute to MCP-based integrations under senior guidance.
• Ingest and enrich third-party data sources with quality checks and reconciliation.

Skills

SQL

Python

PostgreSQL

Azure

Data Factory

Databricks

APIs

CI/CD

Data governance

Stakeholder communication

Tools

Azure Data Factory

Microsoft Fabric

Synapse

Databricks

PostgreSQL

Git

Job description

K3 Advisory Group in Kuala Lumpur is seeking a Data Engineer to build and maintain ELT pipelines, data models and data products powering analytics and AI across its brands. You will work under the Data Lead, delivering secure, auditable data assets for advisors and clients.

Responsibilities include designing pipelines, schemas, API integrations, and governance controls, while collaborating with UK-based stakeholders across time zones in a regulated professional services environment.