Data Engineer

Caring Pharmacy Retail Management Sdn Bhd; Klang City; On-site; MYR 120,000 - 180,000; Full time

Benefits offered by this job

Health Insurance

Awards Programme

Bonus

Study Leave

Job summary

Caring Pharmacy Retail Management Sdn Bhd is seeking a Data Engineer to design, build, and maintain scalable data pipelines and cloud-based data infrastructure. You will collaborate with data scientists, analysts, and business stakeholders to translate requirements into robust data solutions.

The role emphasizes ETL/ELT processes, data warehousing, and data governance, with opportunities to work on AI-powered analytics and dashboard development for informed decision making.

Qualifications

• Bachelor’s degree in Computer Science, Data Engineering, or related discipline (or equivalent practical experience).
• Proven experience in a Data Engineer role.
• Strong proficiency in SQL and at least one programming language (Python or Java).
• Hands-on experience with data warehousing and data lake technologies (BigQuery, Hadoop, Spark).
• Experience designing and maintaining ETL/ELT processes and tools.
• Familiarity with cloud platforms (e.g., GCP) and their data services.
• Strong data modeling and database design principles.
• Strong analytical and problem-solving abilities.
• Excellent communication and collaboration skills.
• Knowledge of end-to-end supply chain logistics is an added advantage.

Responsibilities

• Design, build, and maintain scalable and reliable data pipelines for data ingestion, transformation, and storage.
• Develop and optimize ETL/ELT processes to ensure data quality and consistency.
• Automate data workflows and implement monitoring solutions to ensure pipeline reliability.
• Architect and implement efficient data storage solutions, including data warehouses, data lakes, and databases.
• Ensure data security, integrity, and compliance with relevant regulatory standards.
• Optimize data storage structures and query performance for scalability and efficiency
• Evaluate, recommend, and implement modern data technologies to enhance data infrastructure capabilities.
• Manage and optimize cloud-based data environments (e.g., Google Cloud Platform, BigQuery).
• Develop and maintain comprehensive data documentation, including metadata and data lineage.
• Partner with data scientists, analysts, AI engineers, and business stakeholders to gather and translate data requirements into scalable solutions.
• Clearly communicate technical concepts to both technical and non-technical audiences.
• Participate in code reviews and contribute to knowledge sharing and best practices within the team.
• Continuously optimize data pipelines and infrastructure for performance, scalability, and reliability.
• Troubleshoot and resolve data-related issues in a timely manner.
• Monitor system performance and proactively identify opportunities for improvement.
• Prepare curated "gold layer" datasets for business consumption.
• Develop and maintain user-friendly dashboards using BI tools (e.g., Looker Studio or similar platforms).
• Guide and support business users in leveraging datasets to design or enhance dashboards effectively.
• Collaborate with AI Engineers to co-develop AI-powered analytics solutions, including chatbot interfaces.
• Design scalable data models and define structured schemas to ensure context-ready data for AI applications.

Skills

SQL

Python

Java

Education

Bachelor's degree in Computer Science or related

Tools

BigQuery

Hadoop

Spark

Looker Studio

Job description

We are looking for a skilled and motivated Data Engineer to join our growing data team.

In this role, you will design, build, and maintain scalable data solutions that enable data-driven decision-making across the organization. You will play a key role in developing robust data pipelines, optimizing cloud-based data infrastructure, and supporting analytics and AI initiatives.

Responsibilities

Design, build, and maintain scalable and reliable data pipelines for data ingestion, transformation, and storage.

Develop and optimize ETL/ELT processes to ensure data quality and consistency.

Automate data workflows and implement monitoring solutions to ensure pipeline reliability.

Data Storage and Management

Architect and implement efficient data storage solutions, including data warehouses, data lakes, and databases.

Ensure data security, integrity, and compliance with relevant regulatory standards.

Optimize data storage structures and query performance for scalability and efficiency

Data Infrastructure & Technology

Evaluate, recommend, and implement modern data technologies to enhance data infrastructure capabilities.

Manage and optimize cloud-based data environments (e.g., Google Cloud Platform, BigQuery).

Develop and maintain comprehensive data documentation, including metadata and data lineage.

Partner with data scientists, analysts, AI engineers, and business stakeholders to gather and translate data requirements into scalable solutions.

Clearly communicate technical concepts to both technical and non-technical audiences.

Participate in code reviews and contribute to knowledge sharing and best practices within the team.

Performance Optimization & Support

Continuously optimize data pipelines and infrastructure for performance, scalability, and reliability.

Troubleshoot and resolve data-related issues in a timely manner.

Monitor system performance and proactively identify opportunities for improvement.

Prepare curated "gold layer" datasets for business consumption.

Develop and maintain user-friendly dashboards using BI tools (e.g., Looker Studio or similar platforms).

Guide and support business users in leveraging datasets to design or enhance dashboards effectively.

AI-Driven Data Analytics

Collaborate with AI Engineers to co-develop AI-powered analytics solutions, including chatbot interfaces.

Design scalable data models and define structured schemas to ensure context-ready data for AI applications.

Requirements

Bachelor’s degree in Computer Science, Data Engineering, or a related discipline (or equivalent practical experience).

Proven experience in a Data Engineer or similar role.

Strong proficiency in SQL and at least one programming language (e.g., Python, Java, or similar).

Hands-on experience with data warehousing and data lake technologies (e.g., BigQuery, Hadoop, Spark).

Experience designing and maintaining ETL/ELT processes and tools.

Familiarity with cloud platforms (e.g., GCP) and their data services.

Solid understanding of data modeling and database design principles.

Strong analytical and problem-solving abilities.

Excellent communication and collaboration skills.

Knowledge of end-to-end supply chain logistics is an added advantage.

Willing to travel and relocate to Bukit Raja, Klang

Perks and benefits

• Health Insurance
• Awards Programme
• Bonus
• Study L