Data Engineer (Contract)

PERSOL SINGAPORE PTE. LTD.; Singapore; On-site; SGD 70,000 - 110,000; Full time

Job summary

PERSOL SINGAPORE PTE. LTD. is seeking a data engineer to design and implement scalable data pipelines, optimize SQL queries, and collaborate with analysts and scientists to meet data needs.

The role focuses on building and maintaining cloud data stores, processing large data volumes, and documenting data workflows and models to ensure clear communication across teams.

Qualifications

• Bachelor’s degree in computer science, information technology, or related field.
• 3 years of experience in data engineering.
• Strong knowledge of SQL, ETL, and data extraction/manipulation.
• Experience with complex ETL and data extraction projects from scratch.
• Proficiency in Python, Spark, HIVE-QL, Hadoop ecosystem, Unix/Linux/HDFS.
• Git and CI/CD pipelines knowledge.
• Awareness of data security, privacy, and compliance regulations.

Responsibilities

• Assist in design and implementation of data pipelines to collect, process, and store data from various sources.
• Write and optimize SQL queries for reporting and analysis.
• Collaborate with data analysts and data scientists to understand data requirements and provide data support.
• Organize, build and maintain data stores of structured and unstructured data on a Cloud environment.
• Build data pipelines to enable scalable processing of large volumes of data. Develop scalable and high-performance application architectures using modern development frameworks. Work closely with business stakeholders and project leads to gather requirements and convert them into effective solutions.
• Document data processes, workflows, and data models to maintain clear communication within the team Maintain technical documentation related to application design, workflows, and deployment

Skills

SQL

ETL

Teradata

Python

Spark

Hadoop

HIVE-QL

Unix/Linux

Git CI/CD

Data security & compliance

Education

Bachelor's degree in Computer Science / IT

Tools

Teradata

Git

CI/CD

Hadoop Ecosystem

Job description

Responsibilities

• Assist in the design and implementation of data pipelines to collect, process, and store data from various sources.
• Write and optimize SQL queries to extract and manipulate data for reporting and analysis.
• Collaborate with data analysts and data scientists to understand data requirements and provide the necessary data support.
• Organize, build and maintain data stores of structured and unstructured data on a Cloud environment.
• Build data pipelines to enable scalable processing of large volumes of data. Develop scalable and high-performance application architectures using modern development frameworks. Work closely with business stakeholders and project leads to gather requirements and convert them into effective solutions.
• Document data processes, workflows, and data models to maintain clear communication within the team Maintain technical documentation related to application design, workflows, and deployment

Requirements

• Bachelor’s degree in computer science, Information Technology, or a related field.
• 3 years of experience in data engineering
• Strong knowledge in SQL, ETL Teradata, Hadoop, Python and experience with writing queries for data extraction and manipulation.
• Experience implementing complex ETL and data extraction projects from scratch.
• Fluency in Python, Spark, HIVE-QL, Hadoop eco-system, data-centric workflow management tools Unix/Linux/HDFS environments
• Proficiency in SQL and RDBMS Good working knowledge of Git and CI/CD pipelines
• Experience in Graph database desirable but not mandatory Thorough knowledge of data security, privacy, and compliance regulations