Data Engineering Platform Lead

CTOS; Kuala Lumpur; On-site; MYR 120,000 - 150,000; Full time

Job summary

A leading credit reporting agency in Kuala Lumpur is seeking a Data Management Leader to oversee data ingestion, management, and operations. The ideal candidate will have extensive experience with data platforms and cloud services. You will design and implement data pipelines, ensuring operational excellence and compliance. The role requires a strong background in analytics and proven leadership skills to drive the department’s vision. This position offers opportunities for significant impact and innovation in the financial industry.

Qualifications

• Minimum 10 years’ experience in product/software development.
• Minimum 5 years’ experience working with data platforms.
• Strong knowledge of data platforms and cloud-native services.

Responsibilities

• Oversee activities related to data ingestion and management.
• Execute data extraction and analysis for client needs.
• Design and develop data pipelines from multiple sources.

Skills

Data platforms

Data pipelines

Cloud services (AWS preferred)

SQL

Python/Pandas/PySpark

ETL tools (Talend)

Shell scripting

Monitoring tools (AirFlow)

Data reporting (Grafana, Power BI)

Automated data processes

Education

Bachelor's Degree in Computer Science, Information Technology or equivalent

Tools

Hadoop

Spark

Jupyter

Job description

A leading credit reporting agency in Kuala Lumpur is seeking a Data Management Leader to oversee data ingestion, management, and operations. The ideal candidate will have extensive experience with data platforms and cloud services. You will design and implement data pipelines, ensuring operational excellence and compliance. The role requires a strong background in analytics and proven leadership skills to drive the department’s vision. This position offers opportunities for significant impact and innovation in the financial industry.