Data Engineer: Orchestrate Pipelines & Lakehouse

Combuilder Pte Ltd; Hong Kong; On-site; HKD 420,000 - 660,000; Full time

Job summary

Combuilder Pte Ltd is seeking a Data/Integration Engineer with 3–5 years of experience to design, migrate, and operate data pipelines and workflow orchestrations. You will build ETL processes, ensure data quality, and collaborate with application teams on data requirements and dependencies.

The role involves working with cloud-based platforms and distributed processing frameworks like Spark, implementing robust logging, monitoring, and CI/CD for data workflows.

Qualifications

• 3–5 years of relevant experience in Data Engineering or Integration Engineering.
• Hands-on experience with ETL and file-based data ingestion.
• Proficient in SQL and relational databases such as SQL Server.
• Experience with Spark or other distributed data processing frameworks.
• Experience with Python or other programming languages.
• Understanding of batch and streaming data processing.
• Experience with cloud platforms and managed data services.
• Experience working with REST APIs, JSON and CSV.
• Understanding of CI/CD for data and integration workflows.
• Good understanding of data quality, error handling and pipeline reliability.

Responsibilities

• Analyse and migrate existing workflow integrations to new platforms.
• Develop workflow orchestration, including triggers, routing, retries and exception handling.
• Build automation for batching, pagination, looping and throttling.
• Design and maintain ETL pipelines for file-based data ingestion into relational databases.
• Perform schema validation, data quality checks and error reconciliation.
• Develop data pipelines using cloud-based big data platforms and distributed processing frameworks such as Spark.
• Support Lakehouse-based data environments for batch and streaming workloads.
• Implement logging, monitoring and alerting for data pipelines and workflows.
• Troubleshoot issues and participate in root-cause analysis and continuous improvement.
• Work with application teams to understand data requirements and upstream/downstream dependencies.
• Ensure data pipelines meet performance, reliability, security and governance requirements.

Skills

Data engineering

ETL

SQL

Python

Cloud platforms

REST APIs

Education

Bachelor's degree in Computer Science

Tools

Spark

SQL Server

Flink

REST APIs

Job description

Combuilder Pte Ltd is seeking a Data/Integration Engineer with 3–5 years of experience to design, migrate, and operate data pipelines and workflow orchestrations. You will build ETL processes, ensure data quality, and collaborate with application teams on data requirements and dependencies.

The role involves working with cloud-based platforms and distributed processing frameworks like Spark, implementing robust logging, monitoring, and CI/CD for data workflows.