Azure Data Engineer: PySpark & Synapse Pipelines

FLINTEX CONSULTING PTE. LTD.; Singapore; On-site; SGD 70,000 - 90,000; Full time

Job summary

A leading consulting firm in Singapore is seeking a Data Engineer to design and develop data pipelines using Azure and Pyspark, and maintain datalakes. The ideal candidate will possess a Bachelor's degree in Computer Science or Engineering and 2 years of relevant experience. Responsibilities include managing data pipelines and integration to ensure efficient data handling. Candidates should have solid knowledge of Azure Synapse and strong problem-solving skills. This position offers an opportunity for professional growth in a dynamic environment.

Qualifications

• 2 years of experience in Azure Data engineering, Python, Pyspark or Big Data development.
• Knowledge of Azure Synapse analytics for pipelines and orchestration.
• Experience in Visualization design with Power BI, including row-level security.

Responsibilities

• Design and develop Pyspark scripts and manage data pipelines.
• Implement and maintain a datalake for data storage.
• Conduct data integration using database joins as required.

Skills

Azure Data engineering

Python

Pyspark

SQL

Datawarehouse

Power BI

Education

Bachelor’s Degree in Computer Science or Engineering

Tools

Azure DevOps

Hadoop

Job description

A leading consulting firm in Singapore is seeking a Data Engineer to design and develop data pipelines using Azure and Pyspark, and maintain datalakes. The ideal candidate will possess a Bachelor's degree in Computer Science or Engineering and 2 years of relevant experience. Responsibilities include managing data pipelines and integration to ensure efficient data handling. Candidates should have solid knowledge of Azure Synapse and strong problem-solving skills. This position offers an opportunity for professional growth in a dynamic environment.