Manager, Data Engineering

CTOS Data Systems Sdn Bhd; Petaling Jaya; On-site; MYR 120,000 - 180,000; Full time

Job summary

A leading data solutions provider is seeking a key leader to oversee data ingestion and management. This role involves designing data pipelines, ensuring data quality, and supporting cloud migration efforts while requiring over 10 years of product development experience. The ideal candidate will have a Bachelor's degree in Computer Science, strong skills in SQL, Python, and cloud services, and excellent communication skills. The position is based in Petaling Jaya, Malaysia.

Qualifications

• Minimum 10 years’ experience in product/software development.
• Minimum 5 years’ experience working with data platforms.
• Strong English communication skills.

Responsibilities

• Execute data extraction services for internal/external clients.
• Perform QA activities related to client data services.
• Design processes for data insights and analytics models.
• Support migration of CTOS data services to the cloud.

Skills

Data platforms knowledge

SQL

Python/Pandas/PySpark

Cloud services (AWS preferred)

Data-related development (Hadoop, Spark, etc.)

Automation and monitoring tools

ETL tools (Talend, etc.)

Data reporting solutions (Grafana, Power BI)

Education

Bachelor's Degree in Computer Science or equivalent

Job description

Overview

This role serves as a key leadership position within the department, overseeing all activities related to data ingestion, management of datasets, transformation, extraction, and operations to support both internal and external client needs.

The role is also responsible for shaping the department’s vision and culture, while providing technical expertise and driving a strong focus on operational excellence.

Key Responsibilities

• Execute ad-hoc, monthly and quarterly data extraction services as required by CTOS internal/external clients and in accordance with services SLA
• Perform QA activities related to client data services
• Execute data analysis to provide insight for internal/external needs
• Automate recurrent data related activities
• Investigate data to answer customer complaints related to CTOS services (for example score complain, credit report complaint etc…)
• Design data pipelines to ingest data from multiple sources and implement quality processes
• Design processes to create data insight, data features and operationalize analytics models
• Develop and implement those data pipelines
• Operationalize data pipelines for automated and semi-automated execution
• Implement reporting of data universe, data quality across the organization
• Own the Data Platform, suggest, specify, and implement enhancements to the platform
• Suggest and implement technology components relevant to the data platform
• Support key initiatives including migration of CTOS data services to the cloud

Qualifications

• A Bachelor's Degree, Post Graduate Diploma, or Professional Degree in Computer Science, Information Technology, or equivalent
• Minimum 10 years’ experience in product/software development
• Minimum 5 years’ experience working with data platforms
• Experience working within the financial industry is a plus
• Strong knowledge of data platforms, data pipelines, and data-related development including Hadoop, Spark, Jupyter, and cloud-native services
• Proficient in cloud services and data-related cloud-native services (AWS preferred)
• Proficient in SQL, Python/Pandas/PySpark for implementing data pipelines
• Skilled in automation and monitoring tools such as Shell scripts and scheduling tools like AirFlow
• Experience with ETL tools such as Talend and/or cloud-native ETL services
• Capable of implementing reporting using data platforms or reporting software
• Able to implement data reporting solutions using platforms such as Grafana, Power BI
• Excellent written and verbal communication skills in English
• Able to multi-task and prioritize activities effectively
• Understanding of financial industry data sources (e.g., CCRIS, SSM, Angkasa, Idaman) is a plus

Leadership & Interpersonal Attributes

• Excellent organizational, operational, and leadership skills
• Strong analytical and problem-solving capabilities
• Strategic and business-oriented mindset
• Outstanding communication and interpersonal abilities
• Ability to communicate complex concepts clearly and understandably