Data Engineer: Real-Time Pipelines & Data Platforms

TALENTSIS PTE. LTD.; Singapore; On-site; SGD 90,000 - 140,000; Full time

Job summary

TALENTSIS PTE. LTD. is seeking several Data Engineers to design, build, and maintain scalable data platforms that support data collection, storage, processing, and analytics.

You will develop robust batch and real-time pipelines, ensure data quality and governance, and enable BI and advanced analytics initiatives. Collaborate with internal and external stakeholders, support data modelling with data scientists, and implement secure data architectures.

Qualifications

• 3+ years of experience designing, building, and optimising data pipelines, data architectures, and datasets using ETL/Data Integration tools such as Informatica, Talend, or equivalent.
• Hands-on experience with data transformation, metadata management, workload management, and big data technologies such as Apache Spark, Hadoop, and Hive.
• Strong proficiency in SQL, Python, DBMS, Data Wrangling, Data Visualization.
• Experience working with diverse data sources, including flat files, SQL databases, SAP databases, PostgreSQL, and unstructured data.
• Good understanding of data security, governance, and data quality best practices.
• Strong analytical, troubleshooting, and problem-solving skills.
• Excellent communication and stakeholder management abilities.

Responsibilities

• Collaborate with customers, business stakeholders, partners, and internal teams to understand data requirements and provide technical solutions.
• Partner closely with data scientists and analytics teams to support data modelling and machine learning initiatives.
• Design, develop, document, and maintain scalable data models, ETL/ELT processes, data warehouses, and data pipelines for large volumes of structured and unstructured data.
• Build and optimise batch, near real-time, and real-time data processing solutions.
• Monitor, maintain, and improve the performance, reliability, and scalability of data platforms and pipelines.
• Define, monitor, and report SLAs for data pipelines and data products.
• Implement data security, governance, and compliance standards across data platforms.
• Drive data quality assurance initiatives and establish best practices for data integrity and consistency.
• Support pre-sales activities by providing technical expertise for data management solutions, proposal development, and post-implementation support.

Skills

SQL

Python

Data Wrangling

Data Visualization

ETL/Data Integration

Tools

Informatica

Talend

Apache Spark

Hadoop

Hive

Job description

TALENTSIS PTE. LTD. is seeking several Data Engineers to design, build, and maintain scalable data platforms that support data collection, storage, processing, and analytics.

You will develop robust batch and real-time pipelines, ensure data quality and governance, and enable BI and advanced analytics initiatives. Collaborate with internal and external stakeholders, support data modelling with data scientists, and implement secure data architectures.