Senior Big Data Engineer — Streaming & ETL Specialist

persol tech services pte. ltd.; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

Persol Tech Services Pte Ltd in Singapore is seeking a data engineer to design, develop, and maintain large-scale data systems in a big data environment, handling structured and unstructured data.

You will work with Teradata, Oracle, Hive, Impala, HDFS, Spark, Scala, and HBase, and implement modern data transformation methods using DBT. Real-time data streaming with Kafka and ETL automation with Talend are also involved.

Qualifications

• Bachelor’s degree in computer science, Data Engineering, Information Systems, or a related field.
• Experience in Data Engineering, Big Data solutions, and analytics functions.
• Strong background in traditional structured database environments such as Teradata / Oracle, SQL & PL/SQL.
• Fluent in the management of structured and unstructured data, as well as modern data transformation methodologies and tools like DBT.
• Proficient in Hadoop ecosystem components (e.g., HIVE, Impala, HDFS, Spark, Scala, HBase)
• Hands-on experience working on real-time data and streaming applications using Kafka or other similar tools
• Hands-on experience in automation process – building procedures, ETL and automated job scheduling using data integration tool such as Talend

Responsibilities

• Design, develop, and maintain Big Data solutions for both structured and unstructured data environments.
• Work with traditional structured databases such as Teradata, Oracle, and perform SQL/PLSQL development.
• Manage and process large datasets using the Hadoop ecosystem, including tools like HIVE, Impala, HDFS, Spark, Scala, and HBase.
• Develop and implement modern data transformation methodologies using tools like DBT.

Skills

Data Engineering

Big Data analytics

SQL & PL/SQL

Real-time data processing

Education

Bachelor’s degree in computer science, Data Engineering, Information Systems, or a related field

Tools

Teradata

Oracle

HIVE

Impala

HDFS

Spark

Scala

HBase

DBT

Talend

Kafka

Job description

Persol Tech Services Pte Ltd in Singapore is seeking a data engineer to design, develop, and maintain large-scale data systems in a big data environment, handling structured and unstructured data.

You will work with Teradata, Oracle, Hive, Impala, HDFS, Spark, Scala, and HBase, and implement modern data transformation methods using DBT. Real-time data streaming with Kafka and ETL automation with Talend are also involved.