Data Engineer: Real-Time Big Data Pipelines

PERSOL SINGAPORE PTE. LTD.; Singapore; On-site; SGD 90,000 - 130,000; Full time

Job summary

PERSOL Singapore Pte Ltd is seeking an experienced Data Engineer to design, develop and enhance enterprise-scale data pipelines and data integration solutions across structured and unstructured data environments, supporting high-volume processing and real-time data needs.

The ideal candidate will bring hands-on expertise with Talend, SQL/PLSQL, Teradata/Oracle, Hadoop, Spark and Kafka, plus exposure to DBT, to build robust ETL workflows and scalable data architectures for business insights.

Qualifications

• Minimum 5 years of experience in Data Engineering, Big Data, Data Integration or Analytics Engineering.
• Experience with Teradata and/or Oracle relational databases.
• Advanced knowledge of SQL and PL/SQL.
• Hands-on experience with Talend for ETL and data integration.
• Experience handling structured and unstructured data.
• Experience with DBT and Hadoop ecosystem (Hadoop, Hive, Impala, Spark, Scala, HBase).

Responsibilities

• Design, develop and enhance scalable data pipelines, ETL processes and data architecture.
• Build and maintain data ingestion pipelines using Talend, integrating data from multiple sources.
• Translate business requirements into robust data engineering solutions.
• Develop data transformation, cleansing and processing frameworks to improve quality and availability.
• Build and optimize solutions across traditional databases and Big Data platforms.
• Develop and support real-time and streaming data pipelines using Kafka.
• Support applications and analytics platforms that consume enterprise data for insights.
• Automate manual data processes, ETL workflows and job scheduling.
• Optimize pipelines for performance, scalability, reliability and data quality.
• Participate in UAT, system integration testing and production implementation.
• Troubleshoot data pipeline and production issues and implement sustainable solutions.
• Collaborate with business users, architects, developers and analytics teams on key projects.

Skills

Data engineering

ETL design

Data integration

Stakeholder communication

Tools

Talend

DBT

Hadoop

Spark

Kafka

SQL/PLSQL

Teradata

Oracle

Job description

PERSOL Singapore Pte Ltd is seeking an experienced Data Engineer to design, develop and enhance enterprise-scale data pipelines and data integration solutions across structured and unstructured data environments, supporting high-volume processing and real-time data needs.

The ideal candidate will bring hands-on expertise with Talend, SQL/PLSQL, Teradata/Oracle, Hadoop, Spark and Kafka, plus exposure to DBT, to build robust ETL workflows and scalable data architectures for business insights.