Data Engineer

MR DIY TRADING SDN BHD; Seri Kembangan; On-site; MYR 100,000 - 150,000; Full time

Job summary

A leading company in home improvement retail is seeking a Data Engineer to enhance their data infrastructure. The role involves designing scalable data pipeline solutions, optimizing database systems, and ensuring high data quality. Candidates should possess a relevant degree and hands-on experience with SQL and Python. This position offers an excellent opportunity to contribute to impactful business intelligence initiatives while working in a dynamic and growing team.

Qualifications

• At least Degree in Computer Science, IT, or equivalent.
• Minimum 1 year working experience in system development.
• Hands-on coding experience with ETL, PowerShell, SQL, Python.

Responsibilities

• Design and maintain data pipelines and reporting processes.
• Optimize database systems for efficient querying.
• Integrate data from various sources ensuring quality.

Skills

SQL

Python

ETL

Data consistency

Data accuracy

Education

Degree in Computer Science or Information Technology

Tools

Google Cloud Platform

Big Query

Job description

Responsibilities:

• Design, build, and maintain reliable, scalable data pipelines, data transformation program and data reporting process in Data Warehouse.
• Optimize Database System architecture, partitioning, and clustering strategies for efficient data storage and querying.
• Develop data views to support business intelligence and analytics use cases.
• Integrate data from different data sources to ensure data consistency and quality.
• Implement quality checks and troubleshoot issues to ensure data accuracy and reliability.
• Automate data processing tasks in Data Warehouse.

Requirements / Qualifications:

• At least Degree in Computer Science, Information Technology or equivalent.
• Minimum 1 years working experience on system development work/skill related experience.
• Hands-on experience in coding / scripting development (such as ETL, PowerShell, SQL, Python and SQL Stored Procedure)
• Proficient in SQL script and Python programming with relational databases.
• Added advantage if candidate has experience in Google Cloud Platform and Big Query.