Senior Data Engineer: Big Data, Streaming & DBT Specialist

persol tech services pte. ltd.; Singapore; On-site; SGD 70,000 - 120,000; Full time

Job summary

Persol Tech Services Pte Ltd is seeking a data engineer to design, develop, and maintain large-scale data systems in a big data environment. You will work with structured and unstructured data, and collaborate across teams to deliver robust data pipelines.

Responsibilities include SQL/PLSQL development with Teradata and Oracle, managing datasets with Hadoop tools like HIVE, Impala, HDFS, Spark, Scala, HBase, and implementing DBT-based data transformations, including streaming with Kafka and ETL

Qualifications

• Bachelor’s degree in computer science, data engineering, information systems, or related field.
• Experience in data engineering, big data solutions, and analytics functions.
• Strong background in Teradata and Oracle, SQL & PL/SQL.
• Fluent in managing structured and unstructured data and data transformation tools like DBT.
• Proficient with Hadoop ecosystem components (HIVE, Impala, HDFS, Spark, Scala, HBase).
• Hands-on experience with real-time data and streaming using Kafka or similar tools.
• Hands-on experience automating ETL and job scheduling using data integration tools such as Talend.

Responsibilities

• Design, develop, and maintain Big Data solutions for structured and unstructured data environments.
• Work with Teradata, Oracle; perform SQL/PL/SQL development.
• Manage and process large datasets using the Hadoop ecosystem (HIVE, Impala, HDFS, Spark, Scala, HBase).
• Develop and implement modern data transformation methodologies using tools like DBT.

Skills

Data engineering

Big data

Analytics

Data management

Education

Bachelor’s degree in computer science, data engineering, information systems, or related field

Tools

Teradata

Oracle

HIVE

Impala

HDFS

Spark

Scala

HBase

DBT

Talend

Kafka

Job description

Persol Tech Services Pte Ltd is seeking a data engineer to design, develop, and maintain large-scale data systems in a big data environment. You will work with structured and unstructured data, and collaborate across teams to deliver robust data pipelines.

Responsibilities include SQL/PLSQL development with Teradata and Oracle, managing datasets with Hadoop tools like HIVE, Impala, HDFS, Spark, Scala, HBase, and implementing DBT-based data transformations, including streaming with Kafka and ETL