Data Engineer

Link Compliance; Kuala Lumpur; On-site; MYR 60,000 - 90,000; Full time

Job summary

A leading digital bank in Kuala Lumpur seeks a Data Engineer to develop and maintain data pipelines using Apache Airflow and Python. The ideal candidate will have proven experience in data engineering, manage multiple pipelines, and work collaboratively in agile teams. Join us to enhance our data-driven decision-making capabilities with innovative solutions.

Qualifications

• Proven experience as a Data Engineer in a production environment.
• Strong expertise in Apache Airflow for workflow orchestration.
• Proficiency in Python for data processing tasks.

Responsibilities

• Design, develop, and maintain reliable and scalable data pipelines using Apache Airflow.
• Implement data ingestion, transformation, and validation processes in Python.
• Collaborate closely with product managers, backend engineers, and analysts.

Skills

Apache Airflow

Python

SQL

Data pipelines management

Tools

PostgreSQL

MySQL

Job description

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia

Data Engineer

Job Description:

My client is one of the leading digital banks in Malaysia.

Responsibilities

• Design, develop, and maintain reliable and scalable data pipelines using Apache Airflow.
• Implement data ingestion, transformation, and validation processes in Python to support:
• Loan collection tracking and reporting
• Card payment settlement workflows
• Merchant transaction analysis
• Daily/periodic balance snapshot generation
• Customer loyalty and rewards analytics
• Collaborate closely with product managers, backend engineers, and analysts to ensure data pipelines align with business requirements.
• Monitor, troubleshoot, and optimize data workflows to ensure high performance and reliability.
• Enforce data quality standards and contribute to data governance processes.
• Participate in code reviews and technical design discussions.
• (Optional) Enhance backend data services or processing logic using Java when applicable.
• Stay informed of the latest trends in data engineering to continuously improve pipeline efficiency and robustness.

Qualifications

• Proven experience as a Data Engineer in a production environment.
• Strong expertise in Apache Airflow for workflow orchestration.
• Proficiency in Python for data processing tasks.
• Solid understanding of SQL and experience working with relational databases (e.g., PostgreSQL, MySQL).
• Familiarity with ETL/ELT best practices and data modeling concepts.
• Experience working in agile, product-focused teams.
• Ability to manage multiple pipelines and prioritize tasks effectively.