Junior/Senior Data Engineer - Permanent Role

Visa Hunt; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

talentsis pte. ltd. in Singapore seeks a Senior Data Engineer to design, implement, and maintain data pipelines, data warehouses, and real-time processing solutions in our Singapore operations.

You will collaborate with stakeholders and data scientists to translate requirements into scalable data infrastructure. The role focuses on building robust data models, ETL processes, and governance, while ensuring performance, security, and reliability across large volumes of structured and unstructured

Qualifications

• Experience designing and implementing data pipelines, data models and data warehouses.
• Ability to work with data architects, data scientists and stakeholders to translate requirements into scalable solutions.
• Proficiency with DI/ETL tools and big data technologies such as Spark, Hadoop, and Hive.
• Strong SQL, Python, and data wrangling skills including data quality and governance.

Responsibilities

• Work with customers, partners and colleagues on data-related technical issues and data infrastructure needs.
• Collaborate with data scientists to gather data requirements for modelling work.
• Design, develop, document, and maintain data models, ETL processes, data warehouse, and data pipelines for large volumes of data from multiple sources.
• Define, monitor and report SLAs for data pipelines and data products.
• Ensure data security and governance standards are implemented.
• Drive data quality assurance practices and support pre/post-sales data management initiatives.

Skills

Data Wrangling

Data Visualization

SQL

Python

ETL

Big Data

Informatica

Talend

Kubernetes

Docker

Tools

Power BI

Informatica

Talend

Kubernetes

Docker

Spark

Hadoop

Hive

Job description

We are seeking a Senior Data Engineer that supports the design, implementation and maintenance of data flow channels and data processing systems that support the collection, storage, batch and real-time processing, and analysis of information in a scalable, repeatable and secure manner. The Senior Data Engineer focuses on defining optimal solutions to data collection, processing and warehousing. He / She designs, codes and tests data systems and works on implementing those into the internal infrastructure.

Job Responsibilities

• Work with stakeholders including customers, partners and colleagues on data-related technical issues and support their data infrastructure needs;
• Work closely with data scientists to solicit data requirements to support modeling works
• Design, develop, document, manage and maintain data models, ETL processes, data warehouse, data management and pipeline solutions for large volume of structured/unstructured data from disparate sources and with different latencies (e.g. on-demand, batch, real-time, near-real-time);
• Define, monitor and report SLAs for data pipelines and data products;
• Understand data security and governance standards or requirements to implement solutions that ensure adherence to these standards or meet such requirements;
• Drive/execute data quality assurance practices; and
• Support data management solutions pre-sales initiatives, proposal development and provide post-sales support.

Qualities We Value

• Shall have at least three (3) years' experience in building and optimising data pipelines, architecture and datasets using DI/ETL technology (Informatica, Talend etc).
• Shall have experience in supporting data transformation, data structures, metadata, dependency and workload management, big data technologies (e.g.,Sparks, Hadoop, Hive).
• Shall have the following skill sets: Data Wrangling, Data Visualization, DBMS, SQL, Python
• Experience in multiple data source support (flat files, SQL database, SAP database, PostgreSQL database, unstructured data not limited to text, documents, images, digitalized video, digitalised audio, sensor data) would be advantageous.
• Experience in these products/tools would be advantageous: MS Access (Front-end), SharePoint (Back-end), Power BI (Visualisation), Kubernetes, Docker/Podman, Microservices Architecture, DevSecOps Methodology

(EA Reg No: 20C0312)