Data Engineer - PySpark & ETL for Banking (Singapore)

RISKDATA CONSULTING PTE. LTD.; Singapore; On-site; SGD 90,000 - 150,000; Full time

Job summary

RISKDATA CONSULTING PTE. LTD. is seeking a data engineer with hands-on Python and PySpark experience to support large-scale data processing in a Singapore banking environment.

You will design, develop and maintain ETL pipelines using PySpark, Python and SQL, focusing on data quality, transformation and performance.

Experience with AWS, Azure or Databricks, Agile/Scrum practices and strong stakeholder communication is preferred.

Qualifications

• Proficient in Python and PySpark for large-scale data processing.
• Strong SQL skills, data modelling and performance tuning.
• Experience with data quality, validation and error handling.
• Translate business requirements into scalable data solutions.
• Agile/Scrum experience with strong stakeholder communication.

Responsibilities

• Design, develop and maintain ETL/data pipelines using PySpark, Python and SQL.
• Ensure data quality and error handling in production pipelines.
• Collaborate with stakeholders in a Singapore-based banking environment.
• Optimize performance and scalability of data processing jobs.

Skills

Python

PySpark

SQL

Data modelling

Data quality

Agile/Scrum

Stakeholder management

Tools

Databricks

AWS

Azure

Job description

RISKDATA CONSULTING PTE. LTD. is seeking a data engineer with hands-on Python and PySpark experience to support large-scale data processing in a Singapore banking environment.

You will design, develop and maintain ETL pipelines using PySpark, Python and SQL, focusing on data quality, transformation and performance.

Experience with AWS, Azure or Databricks, Agile/Scrum practices and strong stakeholder communication is preferred.