Information Technology Consultant (Contract)

PERSOL SINGAPORE PTE. LTD.; Singapore; On-site; SGD 90,000 - 130,000; Full time

Job summary

PERSOL SINGAPORE PTE. LTD. in Singapore is seeking a Data Engineer to design and implement data pipelines, process data from multiple sources, and optimize SQL for reporting.

You will collaborate with data analysts and scientists to define data needs and provide robust data support. Responsibilities include building scalable data stores on a Cloud platform, enabling scalable processing of large data volumes, and documenting data models and workflows.

Qualifications

• Bachelor's degree in computer science, information technology, or a related field.
• 4+ years of experience in data engineering.
• Strong knowledge in SQL, ETL, Teradata, Hadoop, Python and data extraction/manipulation.
• Experience with complex ETL and data extraction projects from scratch.

Responsibilities

• Assist in design and implementation of data pipelines to collect, process, and store data from various sources.
• Write and optimize SQL queries to extract and manipulate data for reporting and analysis.
• Collaborate with data analysts and data scientists to understand data requirements and provide data support.
• Organize, build and maintain data stores of structured and unstructured data on a Cloud environment.
• Build data pipelines to enable scalable processing of large volumes of data and develop scalable architectures.
• Document data processes, workflows, and data models; maintain technical deployment documentation.

Skills

SQL

Python

Spark

HiveQL

Hadoop

Unix/Linux

Git

CI/CD

ETL

Teradata

Data security

Education

Bachelor's degree in computer science or IT

Tools

Hadoop

Cloud data stores

Job description

Responsibilities

• Assist in the design and implementation of data pipelines to collect, process, and store data from various sources.
• Write and optimize SQL queries to extract and manipulate data for reporting and analysis.
• Collaborate with data analysts and data scientists to understand data requirements and provide the necessary data support.
• Organize, build and maintain data stores of structured and unstructured data on a Cloud environment.
• Build data pipelines to enable scalable processing of large volumes of data. Develop scalable and high-performance application architectures using modern development frameworks. Work closely with business stakeholders and project leads to gather requirements and convert them into effective solutions.
• Document data processes, workflows, and data models to maintain clear communication within the team Maintain technical documentation related to application design, workflows, and deployment

Requirements

• Bachelor's degree in computer science, Information Technology, or a related field.
• 4+ years of experience in data engineering
• Strong knowledge in SQL, ETL Teradata, Hadoop, Python and experience with writing queries for data extraction and manipulation.
• Experience implementing complex ETL and data extraction projects from scratch.
• Fluency in Python, Spark, HIVE-QL, Hadoop eco-system, data-centric workflow management tools Unix/Linux/HDFS environments
• Proficiency in SQL and RDBMS Good working knowledge of Git and CI/CD pipelines
• Experience in Graph database desirable but not mandatory Thorough knowledge of data security, privacy, and compliance regulations

We regret that only shortlisted candidates will be contacted.