[T07] Data Engineer - Permanent role

TALENTSIS PTE. LTD.; Singapore; Sur place; SGD 90 000 - 130 000; Plein temps

Résumé du poste

TALENTSIS PTE. LTD. in Singapore is seeking a Data Engineer / Senior Data Engineer to design, build and optimize data pipelines, processing platforms and data warehouses to support analytics and business needs.

You will collaborate with data scientists and technical teams to transform data from multiple sources into meaningful insights. This role suits a hands-on data professional who enjoys solving data challenges, working with large datasets and implementing data quality and security practices

Qualifications

• Degree in Computer Science, Information Technology, Data Engineering or related discipline.
• Experience in data engineering, data integration, ETL development, or related areas.
• Hands-on experience building and optimising data pipelines and platforms.
• Experience with ETL/data integration tools such as Informatica or Talend.
• Strong SQL knowledge and relational databases.
• Proficiency in Python.
• Knowledge of Big Data technologies such as Spark, Hadoop, Hive.
• Experience handling data from multiple sources/formats is advantageous.
• Strong analytical and problem-solving skills with stakeholders.

Responsabilités

• Design, develop and maintain data pipelines, ETL processes and data processing solutions for structured and unstructured data.
• Develop and optimise data models, data warehouses and data integration solutions.
• Work with data scientists and other stakeholders to understand data requirements and support analytics and modelling initiatives.
• Handle data from different sources and processing requirements, including batch, real-time and near-real-time data.
• Monitor data pipelines and ensure that data solutions meet agreed performance, reliability and service requirements.
• Implement data quality checks and practices to improve the accuracy, consistency and reliability of data.
• Apply appropriate data security, governance and management practices when developing data solutions.
• Troubleshoot and optimise existing data pipelines and processing workflows.
• Prepare technical documentation relating to data models, pipelines and data processing solutions.
• Support data-related solution design, proposal activities and implementation initiatives when required.

Connaissances

Data modeling

ETL development

Python

SQL

Big data

Data pipelines

Data governance

Spark

Formation

Bachelor's degree in CS/IT/Data Science

Outils

Informatica

Talend

Hive

Hadoop

Description du poste

We are looking for a Data Engineer / Senior Data Engineer to contribute to the development of reliable, scalable and secure data solutions.

You will be involved in building and enhancing data pipelines, data processing platforms and data warehouse solutions that support business and analytics needs. Working closely with technical teams, data scientists and other stakeholders, you will help transform data from multiple sources into meaningful and usable information.

This is an opportunity for a data professional who enjoys working with large datasets, solving data challenges and building data solutions in a dynamic environment.

Key Responsibilities

• Design, develop and maintain data pipelines, ETL processes and data processing solutions for structured and unstructured data.
• Develop and optimise data models, data warehouses and data integration solutions.
• Work with data scientists and other stakeholders to understand data requirements and support analytics and modelling initiatives.
• Handle data from different sources and processing requirements, including batch, real-time and near-real-time data.
• Monitor data pipelines and ensure that data solutions meet agreed performance, reliability and service requirements.
• Implement data quality checks and practices to improve the accuracy, consistency and reliability of data.
• Apply appropriate data security, governance and management practices when developing data solutions.
• Troubleshoot and optimise existing data pipelines and processing workflows.
• Prepare technical documentation relating to data models, pipelines and data processing solutions.
• Support data-related solution design, proposal activities and implementation initiatives when required.

Requirements

• Degree in Computer Science, Information Technology, Data Engineering, Data Science or a related discipline.
• Experience data engineering, data integration, ETL development or related areas.
• Hands-on experience developing and optimising data pipelines, ETL processes and data platforms .
• Experience with ETL / data integration technologies such as Informatica, Talend or similar tools .
• Good understanding of SQL, relational databases and DBMS .
• Programming experience in Python .
• Knowledge of data structures, data transformation, metadata and workload/dependency management.
• Familiarity with Big Data technologies , such as Apache Spark, Hadoop or Hive.
• Experience working with data from multiple sources and formats is advantageous.
• Strong analytical and problem-solving skills, with the ability to work with different stakeholders.

Good to Have

• Experience with any of the following will be an advantage:
• Power BI / Data Visualisation
• PostgreSQL, SAP or other enterprise databases
• Flat files and unstructured data such as documents, images, audio or video
• Kubernetes
• Docker / Podman
• Microservices architecture
• DevSecOps practices
• Microsoft Access and SharePoint

What We Offer

• Permanent employment opportunity
• Exposure to enterprise-level data engineering projects
• Opportunities to work with modern data technologies and platforms
• Collaborative environment with opportunities for professional growth
• Exposure to both technical delivery and solution development initiatives