Senior Data Engineer: Scalable Pipelines & Warehouses

TALENTSIS PTE. LTD.; Singapore; On-site; SGD 90,000 - 130,000; Full time

Job summary

TALENTSIS PTE. LTD. in Singapore is seeking a Data Engineer / Senior Data Engineer to design, build and optimize data pipelines, processing platforms and data warehouses to support analytics and business needs.

You will collaborate with data scientists and technical teams to transform data from multiple sources into meaningful insights. This role suits a hands-on data professional who enjoys solving data challenges, working with large datasets and implementing data quality and security practices

Qualifications

• Degree in Computer Science, Information Technology, Data Engineering or related discipline.
• Experience in data engineering, data integration, ETL development, or related areas.
• Hands-on experience building and optimising data pipelines and platforms.
• Experience with ETL/data integration tools such as Informatica or Talend.
• Strong SQL knowledge and relational databases.
• Proficiency in Python.
• Knowledge of Big Data technologies such as Spark, Hadoop, Hive.
• Experience handling data from multiple sources/formats is advantageous.
• Strong analytical and problem-solving skills with stakeholders.

Responsibilities

• Design, develop and maintain data pipelines, ETL processes and data processing solutions for structured and unstructured data.
• Develop and optimise data models, data warehouses and data integration solutions.
• Work with data scientists and other stakeholders to understand data requirements and support analytics and modelling initiatives.
• Handle data from different sources and processing requirements, including batch, real-time and near-real-time data.
• Monitor data pipelines and ensure that data solutions meet agreed performance, reliability and service requirements.
• Implement data quality checks and practices to improve the accuracy, consistency and reliability of data.
• Apply appropriate data security, governance and management practices when developing data solutions.
• Troubleshoot and optimise existing data pipelines and processing workflows.
• Prepare technical documentation relating to data models, pipelines and data processing solutions.
• Support data-related solution design, proposal activities and implementation initiatives when required.

Skills

Data modeling

ETL development

Python

SQL

Big data

Data pipelines

Data governance

Spark

Education

Bachelor's degree in CS/IT/Data Science

Tools

Informatica

Talend

Hive

Hadoop

Job description

TALENTSIS PTE. LTD. in Singapore is seeking a Data Engineer / Senior Data Engineer to design, build and optimize data pipelines, processing platforms and data warehouses to support analytics and business needs.

You will collaborate with data scientists and technical teams to transform data from multiple sources into meaningful insights. This role suits a hands-on data professional who enjoys solving data challenges, working with large datasets and implementing data quality and security practices