Data Engineer

PEOPLE PROFILERS (SERVICES) PTE. LTD.; Singapore; On-site; SGD 60,000 - 90,000; Full time

Job summary

A data solutions company in Singapore seeks a skilled Data Engineer to refine data collection, implement data engineering jobs, and support system testing. Candidates should have strong SQL, big data experience using Python and ETL tools. The role emphasizes innovation, troubleshooting, and effective communication with stakeholders.

Qualifications

• Strong understanding and completion of projects using waterfall/Agile methodology.
• Ability to troubleshoot complex issues ranging from system resource to application stack traces.
• Passion for automation, standardization, and best practices.

Responsibilities

• Refine data collection/consumption by migrating data collection to efficient channels.
• Plan, design and implement data engineering jobs and reporting solutions.
• Develop test plan and scripts for system testing and support user acceptance testing.

Skills

SQL

Data modelling

Data analysis

Python

PySpark

Linux

ETL tools (Informatica)

Hive

Impala

Cloudera Data Platform

DevOps deployment

Data virtualization tools (Denodo)

Reporting or visualization tools (SAP BO, Tableau)

Job description

Key Responsibilities:

• Refine data collection/consumption by migrating data collection to more efficient channels.
• Plan, design and implement data engineering jobs and reporting solutions to meet the analytical needs.
• Develop test plan and scripts for system testing, support user acceptance testing.
• Work with the Authority’s technical teams to ensure smooth deployment and adoption of new solution.
• Ensure the smooth operations and service level of IT solutions.
• Support production issues - Track record in implementing systems with high availability, high performance, high security.

Requirements:

• Good understanding and completion of projects using waterfall/Agile methodology.
• Good understanding of analytics and data warehouse implementations.
• Ability to troubleshoot complex issues ranging from system resource to application stack traces.
• Strong SQL, data modelling and data analysis skills are a must.
• Hands-on experience in big data engineering jobs using Python, PySpark, Linux, and ETL tools like Informatica.
• Track record in implementing systems using Hive, Impala and Cloudera Data Platform will be preferred.
• Hands-on experience in DevOps deployment and data virtualization tools like Denodo will be preferred.
• Understanding/ Hands on experience of reporting or visualization tool like SAP BO and Tableau will be beneficial but not required.
• Passion for automation, standardization, and best practices
• Good written and verbal communication and interpersonal skills, ability to understand the business requirement, communicate confidently with stakeholders.

People Profilers Pte Ltd

DID: 6950 9738

http://www.peopleprofilers.com

Lim Yi Tian, Candy

EA License No. 02C4944
Registration No. R1109829