Azure Data Engineer for AI Analytics — Hybrid KL

Quantuma; Kuala Lumpur; Hybrid; MYR 120,000 - 180,000; Full time

Job summary

K3 Advisory Group is seeking a Senior Data Engineer to design and operate ELT pipelines across Azure data services, delivering trusted datasets for analytics and AI across multiple brands.

You will work with the Data Lead and a cross-functional squad to implement robust data models, APIs and governance controls, while advancing data quality, lineage and security practices in a regulated professional services environment.

Qualifications

• 4+ years in modern data engineering with cloud platforms — ideally Azure.
• Strong SQL — including PostgreSQL — and Python for data transformation.
• Experience with Azure data services such as Data Factory, Fabric, Synapse or Databricks.
• Solid experience working with APIs: consuming them reliably at scale and exposing data through them.
• Experience with data transformations, reconciliation and version-controlled ETL/ELT pipeline development with CI/CD.
• Working knowledge of star schema and medallion/lakehouse modelling.
• Data governance awareness and practical PII handling experience.
• Able to communicate clearly with UK-based stakeholders and work across time zones.
• Desirable: MCP, ML/AI workloads, and governance tooling familiarity.

Responsibilities

• Develop ELT pipelines from SaaS, ERP, CRM and finance systems into the Azure data platform (Azure Data Lake, Synapse/Databricks, PostgreSQL).
• Design and implement data models (star schema and medallion/lakehouse) with semantic layers for product, dashboards and AI.
• Implement transformations using SQL and Python within version-controlled, code-reviewed workflows.
• Manage schema evolution and CDC to keep downstream models stable as sources change.
• Optimise pipeline and query performance, including PostgreSQL tuning, balancing cost, freshness and reliability.
• Build robust API integrations to ingest data from third-party and internal systems.
• Expose governed datasets to third-party systems and internal products via APIs and data views.
• Contribute to MCP-based integrations under senior guidance.
• Ingest and enrich external data sources with quality checks and reconciliation.
• Support onboarding of acquired businesses onto the Group data platform.

Skills

SQL

Python

PostgreSQL

Azure

Data Factory

Databricks

APIs

ETL/ELT

Data Modelling

Data Governance

CI/CD

PII Handling

Job description

K3 Advisory Group is seeking a Senior Data Engineer to design and operate ELT pipelines across Azure data services, delivering trusted datasets for analytics and AI across multiple brands.

You will work with the Data Lead and a cross-functional squad to implement robust data models, APIs and governance controls, while advancing data quality, lineage and security practices in a regulated professional services environment.