Data Engineer: ETL Pipelines, SQL Server & Power BI

Pentas Flora Management Services Sdn Bhd; Kuala Lumpur; On-site; MYR 90,000 - 180,000; Full time

Job summary

PENTAS FLORA is seeking a Data Engineer to manage and modernise its enterprise data integration and data warehouse environment. You will develop pipelines to extract data from Core System and other business systems, transform and validate it with Python and ETL tools, and load into Microsoft SQL Server for reporting and analytics.

The role requires a Bachelor's degree and at least 3 years of hands-on experience in data engineering, ETL or data warehousing, with strong SQL Server, Python, and

Qualifications

• Bachelor's degree in computer science, IT, data engineering or a related discipline.
• Minimum 3 years of hands-on data engineering, ETL or data warehousing experience.
• Strong practical experience with Microsoft SQL Server, T-SQL and Python-based data processing.
• Strong Python capability for production data extraction, transformation and loading.
• Good understanding of dimensional modelling, ETL pipelines, incremental loading and data quality controls.
• Experience with incremental loading, data validation, exception handling and reconciliation.
• Understanding of layered data architecture such as Medallion Architecture or an equivalent approach.

Responsibilities

• Develop and maintain Python-based ETL pipelines to extract, transform, validate and load data from Core System and other business systems.
• Implement full and incremental data-loading processes with error handling, logging, reconciliation and recovery mechanisms.
• Monitor scheduled pipelines, troubleshoot issues and ensure reliable data processing.
• Design and maintain a Microsoft SQL Server-based data warehouse using dimensional modelling, fact and dimension tables, star schemas and historical data management.
• Support layered architecture based on Medallion Architecture, or equivalent Raw, Staging, Curated and Business-ready layers.
• Develop and optimise T-SQL queries, views and stored procedures to support efficient data processing.
• Implement data quality controls covering completeness, accuracy, duplicates and source-to-target reconciliation.
• Maintain data dictionaries, data mappings, business rules, data lineage and technical documentation.
• Provide reliable and business-ready datasets for Microsoft Power BI and enterprise reporting.
• Assess the existing Python ETL environment and identify opportunities to improve reliability, scalability and maintainability.

Skills

Python programming

ETL design

Data warehousing

T-SQL

Education

Bachelor's Degree in Computer Science / IT / Data Engineering

Tools

Microsoft SQL Server

Power BI

Azure Data Factory

SSIS

REST API integration

Job description

PENTAS FLORA is seeking a Data Engineer to manage and modernise its enterprise data integration and data warehouse environment. You will develop pipelines to extract data from Core System and other business systems, transform and validate it with Python and ETL tools, and load into Microsoft SQL Server for reporting and analytics.

The role requires a Bachelor's degree and at least 3 years of hands-on experience in data engineering, ETL or data warehousing, with strong SQL Server, Python, and