Data Integration Engineer

TG HUMAN RESOURCE MANAGEMENT SERVICES SDN BHD; Selangor; On-site; MYR 60,000 - 80,000; Full time

Job summary

A human resource management firm in Selangor is seeking a skilled Data Integration Engineer. The ideal candidate will design and maintain data integration pipelines, develop low-code/no-code solutions, and monitor data performance. Requirements include a Bachelor's Degree in Computer Science and 3+ years of experience in data integration and ETL tools. Familiarity with tools like Talend and Kafka is essential. This position offers the opportunity to work in a dynamic environment focused on data quality and security.

Qualifications

• 3+ years of hands-on experience in data integration, ETL development, or data engineering.
• Familiarity with data integration tools.
• Solid understanding of data governance and security principles.

Responsibilities

• Design, develop, and maintain robust data integration pipelines.
• Utilize low-code/no-code platforms for integration processes.
• Monitor and optimize data transfer performance.
• Assist in resolving production pipeline issues.

Skills

Data integration

ETL development

Data engineering

Streaming technologies

Scripting in Python

Education

Bachelor’s Degree in Computer Science

Tools

Talend

Informatica

Fivetran

RudderStack

Zapier

Kafka

Pub/Sub

Job description

TG HUMAN RESOURCE MANAGEMENT SERVICES SDN BHD – Selangor

Permanent

1d ago , from TG HUMAN RESOURCE MANAGEMENT SERVICES SDN BHD

• Data Integration Pipeline Development: Design, develop, and maintain robust data integration pipelines that connect internal systems, third-party tools, and customer applications, ensuring data consistency and high quality.
• Low-Code/No-Code Solutions: Utilize low-code/no-code platforms to accelerate the integration process while employing custom development for more complex pipeline requirements.
• Collaboration with Internal Teams: Work closely with various teams to gather requirements and implement data flows that align with business needs, including compliance, finance, and customer-facing applications.
• Performance Monitoring: Monitor and optimize data transfer performance to ensure that integrations remain efficient, scalable, and secure.
• Incident Management: Assist in resolving production pipeline issues and coordinate closely with the team to respond to and rectify incidents swiftly.
• Real-Time and Batch Processing: Manage real-time and batch data transfer activities, collaborating with engineering and back-end teams to tackle complex integration challenges.

Job Requirements

• Education: Bachelor’s Degree in Computer Science, Data Engineering, or a related field.
• Experience: 3+ years of hands-on experience in data integration, ETL development, or data engineering.
• Integration Tools Proficiency: Familiarity with data integration tools such as Talend, Informatica, Fivetran, RudderStack, Zapier, or similar low-code/no-code platforms.
• Streaming Technologies: Experience working with real-time data systems and streaming technologies like Kafka, Pub/Sub, or comparable tools.
• Data Governance Understanding: Solid understanding of data governance, privacy, and security principles, particularly within regulated environments (e.g., GDPR compliance).
• Strong knowledge of SQL, API development, and cloud-based data storage solutions (such as Google Cloud or AWS).
• Scripting Languages: Familiarity with Python or similar scripting languages for data manipulation.