Senior Data Engineering Analyst

CTOS; Kuala Lumpur; On-site; MYR 80,000 - 120,000; Full time

Job summary

A leading credit reporting agency in Kuala Lumpur is seeking a proactive individual to oversee the implementation of cloud-based ETL processes. This role involves managing data ingestion, cleansing, and pipelines while ensuring compliance with data security. The ideal candidate should possess a Bachelor's Degree in Computer Science or a related field, along with at least 4 years of relevant experience in ETL tools, data platforms, and cloud services, preferably AWS. Strong communication skills are essential for this role.

Qualifications

• Minimum 4 years of experience with ETL/ELT tools.
• Minimum 4 years of experience working with data platforms.
• Excellent written and verbal communication skills, including English.

Responsibilities

• Execute ad-hoc data extraction services as required by clients.
• Perform QA activities related to client data services.
• Design data pipelines to ingest data from multiple sources.

Skills

ETL/ELT tools

Data platforms

Dashboard development

Cloud services (AWS preferred)

SQL

Python/Pandas/PySpark

Automation and monitoring tools

Grafana

Power BI

Education

Bachelor’s Degree in Computer Science or related field

Tools

Talend

AWS Glue

EMR

S3

Job description

We are Malaysia’s leading Credit Reporting Agency (CRA) and we are aggressively expanding our business, and looking for dynamic, driven and motivated individuals to join our team. Our Direct-To-Consumer segment (D2C), is one of our fastest growing product areas in the market, with an abundance of expansion plans and innovative ideas on hand.

ROLE OVERVIEW

Thisrole oversees the complete implementation of cloud-based ETL processes, dataoperations, and automation to meet internal and external client requirements.Responsibilities encompass data ingestion, cleansing, transformation, andextraction, along with developing and operationalizing data pipelines. Dailyoperations include managing BAU tasks and supporting specific projectinitiatives.

KEYRESPONSIBILITIES

• ·Execute ad-hoc, monthly and quarterly dataextraction services as required by CTOS internal/external clients and inaccordance with services SLA
• ·Perform QA activities related to client dataservices
• ·Execute data analysis to provide insight forinternal/external needs
• ·Automate recurrent data related activities
• ·Ensure zero non-compliances on process audit ondata security and compliance

Data pipeline development and operationalization

• ·Design data pipelines to ingest data from multiplesources and implement quality processes
• ·Design processes to create data insight, datafeatures and operationalize analytics models
• ·Develop and implement those data pipelines
• ·Maintain and develop the cloud services relatingto data pipelines
• ·Operationalize data pipelines for automated andsemi-automated execution
• ·Implement reporting of data universe, data qualityacross the organization
• ·Implement Dashboard and reports based onstakeholder requirements
• ·Ensure zero non-compliances on process audit ondata security and compliance
• ·Support key initiatives including migration ofCTOS data services to the cloud

WHATDOES IT TAKE TO BE SUCCESSFUL

Qualifications

• ·A Bachelor’s Degree, PostGraduate Diploma, or Professional Degree in Computer Science, InformationTechnology, or a related field

WorkExperience

• ·Minimum 4 years of experiencewith ETL/ELT tools
• ·Minimum 4 years of experienceworking with data platforms
• ·Minimum 4 years of experiencein dashboard development and automation
• ·Minimum 4 years of experiencewith cloud services (AWS preferred)
• ·Experience working in thefinancial industry is a plus
• ·Strong knowledge of dataplatforms, data pipelines, and data-related development (e.g., Hadoop, Spark,Jupyter, cloud-native services)
• ·Proficient in cloud servicesand cloud-native data tools (AWS preferred)
• ·Skilled in programminglanguages and tools for data pipelines (e.g., SQL, Python/Pandas/PySpark)
• ·Proficient with automation andmonitoring tools (e.g., shell scripting, Airflow)
• ·Experienced with ETL toolssuch as Talend and/or cloud-native services like EMR, AWS Glue, EC2, S3
• ·Capable of troubleshootingdata issues
• ·Able to implement datareporting solutions using platforms such as Grafana, Power BI
• ·Excellent written and verbalcommunication skills, including English
• ·Understanding of financialdata systems (e.g., CCRIS, SSM, Angkasa, Idaman) is a plus

Interpersonal& Cross-Cultural Skills

• ·Outstanding communication andinterpersonal abilities
• ·Able to convey complextechnical concepts in a clear, accessible manner