Data Engineer

Systems Limited - APAC; Kuala Lumpur; On-site; MYR 180,000 - 300,000; Full time

Job summary

Systems Limited APAC is hiring data engineers to design, build, and maintain scalable data pipelines and infrastructure that support analytics, reporting, and business intelligence initiatives.

Join a team delivering end-to-end data platforms using Microsoft Fabric, OneLake, Data Factory, Spark, and Data Warehouses, while shaping data models and streaming pipelines for banking and telecom domains.

Qualifications

• 7 years of data engineering experience in Banking or Telecom domains.
• Strong hands-on with Azure, AWS, Snowflake.
• Proficient in Python/Scala/Java.
• Experience building ETL/ELT pipelines.
• Knowledge of data warehousing and dimensional modelling.
• Exposure to Microsoft Fabric/Data Platform.
• Familiarity with Airflow, ADF, and streaming tech.
• Degree in CS/Engineering or related field.

Responsibilities

• Lead end-to-end solution architecture and design for Microsoft Fabric-based data platforms.
• Design scalable cloud data architectures aligned with business needs.
• Develop enterprise data models to support analytics and reporting.
• Architect and implement data engineering solutions using Microsoft Fabric, OneLake, Data Factory, Spark, and Data Warehouses.
• Design and optimize data ingestion, transformation, integration, and orchestration pipelines.
• Architect real-time and streaming data solutions using Eventstreams and Spark Structured Streaming.
• Collaborate with stakeholders to translate business needs into technical solutions.
• Optimize platform performance, reliability, and cost efficiency.
• Provide technical leadership and mentorship to data engineers.
• Define architecture standards and roadmaps.
• Stay current with Microsoft Fabric and Azure Data Platform best practices.

Skills

Python

Scala

Java

ETL/ELT pipelines

Data modelling

Dimensional modelling

Spark

Kafka

Education

Bachelor's or Master's degree in Computer Science, Engineering, or related field

Tools

Azure

AWS

Snowflake

Spark

Kafka

Airflow

Azure Data Factory

Job description

Systems Limited APAC is hiring data engineers to design, build, and maintain scalable data pipelines and infrastructure that support analytics, reporting, and business intelligence initiatives.

Responsibilities:

• Lead end-to-end solution architecture and design for Microsoft Fabric-based data platforms.
• Design scalable and high-performance cloud data architectures aligned with business requirements.
• Develop and maintain enterprise data models (conceptual, logical, and physical) to support analytics and reporting.
• Architect and implement modern data engineering solutions using Microsoft Fabric, OneLake, Data Factory, Spark, and Data Warehouses.
• Design and optimize data ingestion, transformation, integration, and orchestration pipelines.
• Architect real-time and streaming data solutions using Eventstreams, KQL databases, Spark Structured Streaming, and other Microsoft Fabric streaming capabilities.
• Collaborate with business stakeholders, solution architects, and engineering teams to translate business needs into technical solutions.
• Optimize platform performance, scalability, reliability, and cost efficiency.
• Provide technical leadership, architecture reviews, and mentorship to data engineers and developers.
• Define architecture standards, reference patterns, and implementation roadmaps.
• Stay current with Microsoft Fabric, Azure Data Platform, and industry best practices to drive continuous innovation.

Requirements:

• Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
• 7 years of experience in Data Engineering specifically in Banking or Telecom (Telco) domains.
• Strong hands-on experience in Azure, AWS and Snowflake.
• Programming knowledge in Python, Scala, or Java.
• Experience in building ETL/ELT pipelines.
• Good understanding of data warehousing and dimensional modelling.
• Exposure to Microsoft Dynamics 365 (D365) data platforms.
• Experience with Azure Synapse Link or Microsoft Fabric Link.
• Knowledge of Spark, Kafka, or other big data technologies.
• Familiarity with orchestration tools (Airflow, ADF).