Data Engineer

PURESOFTWARE PTE. LTD.; Singapore; On-site; SGD 70,000 - 90,000; Full time

Job summary

A leading software development company in Singapore is seeking a results-driven Data Engineer. This role involves designing and implementing scalable data pipelines using Azure services. Candidates should have hands-on experience with SQL, data quality management, and building integration solutions. Join a dynamic team focused on optimizing data workflows and ensuring data reliability in analytics and reporting.

Qualifications

• Hands-on experience in designing and implementing scalable data pipelines.
• Skilled in SQL development and building end-to-end data integration solutions.
• Experience with Azure services and optimizing performance for high-volume datasets.

Responsibilities

• Implement data quality checks and monitoring mechanisms.
• Collaborate with data analysts to translate requirements into technical solutions.
• Design and manage data models and schemas for efficient querying.

Skills

Azure Databricks

Azure Data Factory

Apache Spark

SQL development

Cosmos DB

ETL/ELT data pipelines

data quality checks

data modeling

workflow automation

Job description

Results-driven Data Engineer with hands-on experience in designing and implementing scalable data pipelines using Azure Databricks, Azure Data Factory, and Apache Spark. Skilled in SQL development, Cosmos DB, and building end-to-end data integration solutions for analytics and reporting. Develop, optimize, and maintain ETL/ELT data pipelines to ensure reliable data flow across systems.

• Implement data quality checks, validation frameworks, and monitoring mechanisms to ensure accuracy and consistency.
• Collaborate with data analysts and business stakeholders to translate requirements into technical solutions.
• Design and manage data models and schemas for efficient querying and storage in analytical environments.
• Optimize Spark and SQL performance for high-volume datasets in cloud environments.
• Automate workflows and data ingestion processes using Azure Data Factory pipelines and orchestration tools.