Data Engineer

VAT Group; Seberang Perai; On-site; MYR 80,000 - 110,000; Full time

Job summary

A leading data solutions provider in Malaysia seeks a Data Engineer to build and maintain robust pipelines for analytics. You will integrate varied data sources, ensuring reliability and performance. The ideal candidate has a Bachelor's in Computer Science, with at least 3 years of relevant experience and strong skills in Python and SQL. Join a collaborative global team focused on delivering high-quality data solutions while optimizing storage and processing systems.

Qualifications

• Minimum 3 years of experience as a Data Engineer or related role.
• Strong experience in building and maintaining data pipelines.
• Proficiency in SQL for querying and performance optimization.

Responsibilities

• Develop and maintain robust data pipelines for analytics.
• Integrate data from multiple sources to ensure consistency.
• Monitor system performance and troubleshoot issues.

Skills

Data pipeline construction

Data integration

Data storage solutions

Python

SQL

Problem-solving

Collaboration

Fluent English

Education

Bachelor’s degree in Computer Science or related field

Tools

Azure Synapse Analytics

Microsoft Fabric

CI/CD practices

Git

Job description

As a Data Engineer, you will be responsible for building and maintaining the data infrastructure that powers VAT’s analytics and business intelligence solutions. Your work ensures that data is accessible, reliable, and performant—enabling teams across the organization to make informed, data-driven decisions.

You will be part of a global IT team spanning Romania, Switzerland and Malaysia, collaborating across time zones and disciplines. Your focus will be on developing robust data pipelines, integrating diverse data sources, and optimizing data storage and processing systems to support scalable and high-quality analytics solutions.

Responsibilities

• Develop, construct, and maintain robust and scalable data pipelines to support analytics and reporting needs across the organization.
• Integrate data from multiple sources, ensuring consistency, reliability, and alignment with business requirements.
• Design and manage data storage solutions, including data lakes and data warehouses, with a focus on scalability and performance.
• Optimize data processing and retrieval, ensuring efficient performance across the data platform.
• Implement and monitor data quality measures, ensuring accuracy, completeness, and consistency of data across systems.
• Monitor system performance, troubleshoot issues, and design improvements to enhance stability, reliability, and scalability.
• Collaborate with cross-functional teams, including analytics engineers, business analysts, and IT stakeholders, to deliver high-quality data solutions.

Required Qualifications

• Minimum 3 years of experience as a Data Engineer or in a similar role focused on data infrastructure, pipelines, or platform engineering.
• Bachelor’s degree in Computer Science, Information Systems, Data Engineering, or a related field — or equivalent professional experience.
• Strong experience in building and maintaining data pipelines, including data ingestion, transformation, and orchestration.
• Solid understanding of data integration from multiple sources and ensuring data consistency and reliability.
• Experience with data storage solutions such as data lakes and data warehouses.
• Proficiency in Python, PySpark, or other programming languages used for data processing and orchestration.
• Proficiency in SQL for data querying, transformation, and performance optimization.
• Proficiency in monitoring and troubleshooting data systems, with a focus on performance and stability.
• Strong problem-solving skills and attention to detail.
• Ability to work independently and collaboratively in a cross-functional, multicultural team.
• Fluent in English, both written and spoken.

Preferred Qualifications

• Experience with Microsoft Fabric, Azure Synapse Analytics, or similar modern data platforms.
• Familiarity with CI/CD practices, version control (e.g. Git), and infrastructure-as-code tools.
• Knowledge of data governance, data quality frameworks, and compliance standards.
• Experience with monitoring and observability tools for data pipelines and infrastructure.
• Exposure to cloud-based architectures and services (e.g. Azure Data Lake, Azure Data Factory).
• Experience working in agile environments, applying Scrum methodology.

Microsoft Certification: Fabric Data Engineer Associate (DP-700)

Be careful - Don’t provide your bank or credit card details when applying for jobs. Don’t transfer any money or complete suspicious online surveys. If you see something suspicious, report this job ad.