Data Engineer (ETL Solutions)

PERSOL SINGAPORE PTE. LTD.; Singapore; On-site; SGD 90,000 - 150,000; Full time

Job summary

PERSOL SINGAPORE PTE. LTD. is seeking a data engineering professional to migrate Talend ETL jobs to Spark-based pipelines, design scalable data lake solutions, and deliver Databricks/Informatica IDMC projects.

You will collaborate with data architects, deploy PySpark/Scala workflows across AWS/Azure/GCP, and manage orchestration with Airflow or Databricks Jobs. This role requires 5+ years in data engineering and strong SQL/warehousing knowledge.

Qualifications

• Degree in Computer Science, IT, CE or equivalent.
• 5+ years in data engineering with AWS or Azure, Databricks and/or Informatica IDMC.
• Hands-on in multiple project lifecycles (≥4) and strong ETL/warehousing knowledge.
• Proficient in SQL and data warehousing concepts.
• Familiar with cloud services (AWS, Azure, GCP).

Responsibilities

• Analyze existing Talend ETL jobs and design Spark-based pipelines.
• Migrate and optimize data workflows from Talend to Spark (PySpark/Scala).
• Collaborate with data architects to define scalable data lake/lakehouse solutions.
• Develop data warehousing, ETL and BI projects in Informatica IDMC and Databricks.
• Responsible for all technical development work and support leads on design and impact analysis.
• Integrate Spark pipelines with cloud platforms (AWS, Azure, GCP).
• Work with orchestration tools (Airflow, Databricks Jobs) to schedule and monitor workflows.

Skills

Data engineering

ETL concepts

SQL

Project lifecycle

Data modeling

Education

Degree in Computer Science/IT/CE or equivalent

Tools

Talend ETL

Spark

PySpark

Scala

Databricks

Informatica IDMC

Airflow

AWS

Azure

GCP

Job description

Responsibilities

• Analyze existingTalend ETL jobsand design equivalentSpark-based pipelines.
• Migrate and optimize data workflows from Talend to Spark (PySpark/Scala).
• Collaborate with data architects to define scalable data lake/lakehouse solutions.
• Developer for data-warehousing, ETL and BI projects in Informatica IDMC and Databricks.
• Responsible for all technical development work and support the leads on technical design and systems impact analysis.
• Integrate Spark pipelines with cloud platforms (AWS, Azure, GCP).
• Work with orchestration tools (Airflow, Databricks Jobs, etc.) to schedule and monitor workflows.

Skills/Requirement

• Degree in Computer Science, Information Technology, Computer Engineering or equivalent
• Minimum 5 years of experience in data solutions, data engineering, with expertise in AWS or Azure services, Databricks, and/or Informatica IDMC.
• Understanding and hands on experience in all phases of project lifecycle & has implementation involvement in at least 4 project cycles.
• Solid understanding of ETL, data warehousing conceptsandSQL.
• Familiarity withcloud services(AWS EMR, Azure Databricks, GCP DataProc).

We regret to inform you that only shortlisted candidates will be contacted.