Data Engineer

Encora Inc.; Kuala Lumpur; On-site; MYR 40,000 - 60,000; Full time

Job summary

A leading company in digital engineering is looking for a motivated Data Engineer to join their team in Kuala Lumpur. The role involves designing and maintaining data pipelines and collaborating with data scientists and analysts to enhance data availability and integrity. This full-time on-site position offers the opportunity to work with cutting-edge technologies in a dynamic environment.

Qualifications

• 5 years of experience in software development and data-related projects.
• Hands-on experience with data platforms and tools.
• Experience in cloud services, especially AWS.

Responsibilities

• Design and maintain ETL/ELT pipelines for data processing.
• Collaborate with data teams to ensure data quality and availability.
• Implement data solutions based on requirements.

Skills

Data Platforms

Data Pipelines

SQL

Python

ETL tools

Cloud Services

Airflow

Apache Spark

Kafka

Job description

Important Information

Location: Kuala Lumpur Malaysia

Experience: 5 years

Job Mode: Full-time Contract

Work Mode: On-Site



Job Summary

Skilled and motivated Data Engineer to join our data infrastructure team. In this role, you will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support analytics, reporting, and data science initiatives. You will work closely with data scientists, analysts, and software engineers to ensure data availability, quality, and integrity across the organization.

Responsibilities & Duties

• Design, develop, and maintain robust and scalable ETL/ELT pipelines to process structured and unstructured data from various sources.
• Build and maintain data infrastructure and architecture (e.g., data lakes, data warehouses).
• Collaborate with data analysts, scientists, and business stakeholders to understand data requirements and deliver data solutions.
• Ensure data quality and consistency by implementing monitoring and validation processes.
• Optimize performance and scalability of data systems.
• Manage data ingestion, transformation, and storage using tools like Apache Spark, Kafka, Airflow, etc.
• Maintain documentation and ensure compliance with data governance and security standards.
• Assist with migrating data pipelines and infrastructure to cloud platforms (e.g., AWS, GCP, Azure).
  
  

Qualifications & Skills

• Have experience in product / software development and have experience in process and delivery ownership
• Hands on working experience on Data Strong knowledge of data platforms, data pipelines, data related development including platforms such as Hadoop, Spark, Jupyter, cloud native services
• Hands on experience on cloud services and knowledge of data related cloud native services (AWS).
• Tools and programming languages required to implement data pipelines: SQL, Python / Pandas
• Tools required to implement automation and monitoring: Shell scripts, scheduling tools such as AirFlow
• Have experience in ETL tools such as Talend and/or cloud native services
• Experience implementing reporting using a data platform or reporting software (QuickSight, Power BI,etc.) product / software development
• Hands on working experience on Data Strong knowledge of data platforms, data pipelines, data related development including platforms such as Hadoop, Spark, Jupyter, cloud native services
  
  

About Encora

Encora is the preferred digital engineering and modernization partner of some of the world's leading enterprises and digital native companies. With over 9,000 experts in 47+ offices and innovation labs worldwide, Encora's technology practices include Product Engineering & Development, Cloud Services, Quality Engineering, DevSecOps, Data & Analytics, Digital Experience, Cybersecurity, and AI & LLM Engineering.



At Encora, we hire professionals based solely on their skills and qualifications, and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.