Senior Data Engineer

persol tech services pte. ltd.; Singapore; On-site; SGD 70,000 - 120,000; Full time

Job summary

Persol Tech Services Pte Ltd is seeking a data engineer to design, develop, and maintain large-scale data systems in a big data environment. You will work with structured and unstructured data, and collaborate across teams to deliver robust data pipelines.

Responsibilities include SQL/PLSQL development with Teradata and Oracle, managing datasets with Hadoop tools like HIVE, Impala, HDFS, Spark, Scala, HBase, and implementing DBT-based data transformations, including streaming with Kafka and ETL

Qualifications

• Bachelor’s degree in computer science, data engineering, information systems, or related field.
• Experience in data engineering, big data solutions, and analytics functions.
• Strong background in Teradata and Oracle, SQL & PL/SQL.
• Fluent in managing structured and unstructured data and data transformation tools like DBT.
• Proficient with Hadoop ecosystem components (HIVE, Impala, HDFS, Spark, Scala, HBase).
• Hands-on experience with real-time data and streaming using Kafka or similar tools.
• Hands-on experience automating ETL and job scheduling using data integration tools such as Talend.

Responsibilities

• Design, develop, and maintain Big Data solutions for structured and unstructured data environments.
• Work with Teradata, Oracle; perform SQL/PL/SQL development.
• Manage and process large datasets using the Hadoop ecosystem (HIVE, Impala, HDFS, Spark, Scala, HBase).
• Develop and implement modern data transformation methodologies using tools like DBT.

Skills

Data engineering

Big data

Analytics

Data management

Education

Bachelor’s degree in computer science, data engineering, information systems, or related field

Tools

Teradata

Oracle

HIVE

Impala

HDFS

Spark

Scala

HBase

DBT

Talend

Kafka

Job description

About the Project

Building and maintaining large scale data systems in big data environment.

Responsibilities

• Design, develop, and maintain Big Data solutions for both structured and unstructured data environments.
• Work with traditional structured databases such as Teradata, Oracle, and perform SQL/PLSQL development.
• Manage and process large datasets using the Hadoop ecosystem, including tools like HIVE, Impala, HDFS, Spark, Scala, and HBase.
• Develop and implement modern data transformation methodologies using tools like DBT.

Skills/Requirement

• Bachelor’s degree in computer science, Data Engineering, Information Systems, or a related field.
• Experience in Data Engineering, Big Data solutions, and analytics functions.
• Strong background in traditional structured database environments such as Teradata / Oracle, SQL & PL/SQL.
• Fluent in the management of structured and unstructured data, as well as modern data transformation methodologies and tools like DBT.
• Proficient in Hadoop ecosystem components (e.g., HIVE, Impala, HDFS, Spark, Scala, HBase).
• Hands-on experience working on real-time data and streaming applications using Kafka or other similar tools.
• Hands-on experience in automation process – building procedures, ETL and automated job scheduling using a data integration tool such as Talend.

By sending us your personal data and curriculum vitae (CV), you are deemed to consent to PERSOL Tech Services Pte Ltd and its local and overseas subsidiaries and affiliates to collect, use and disclose your personal data for the purposes set out in the Privacy Policy. Our full privacy policy is available at https://www.persoloutsourcing.com/policies.