Data Engineer - PySpark, ETL, Big Data (Banking)

UARROW PTE. LTD.; Singapore; On-site; SGD 90,000 - 150,000; Full time

Job summary

UARROW PTE. LTD. in Singapore is seeking a data engineer to develop and maintain large-scale data processing pipelines using Python and PySpark, in a Singapore banking environment.

You will design ETL pipelines with PySpark, Python and SQL, work with Big Data technologies, and ensure data quality, validation and error handling, while collaborating in Agile teams.

The role requires strong communication to manage stakeholders and translate business requirements into scalable technical solutions.

Qualifications

• Strong hands-on experience in Python and PySpark development for large-scale data processing.
• Design, develop and maintain ETL/data pipelines using PySpark, Python and SQL.
• Experience with Big Data technologies, data transformation and batch processing.
• Strong knowledge of SQL, data modelling, performance tuning and optimization.
• Experience with cloud/data platforms such as AWS, Azure, Databricks or equivalent is preferred.
• Good understanding of data quality, reconciliation, validation and error handling.
• Ability to analyse business requirements and translate them into scalable technical solutions.
• Experience working in Agile/Scrum environments with strong communication and stakeholder-management skills.
• Candidates should be available to work in a Singapore-based banking environment.

Skills

Python

PySpark

SQL

Big Data

Data Modelling

Performance Tuning

Agile/Scrum

Stakeholder Management

Data Quality

Tools

Databricks

AWS

Azure

Job description

UARROW PTE. LTD. in Singapore is seeking a data engineer to develop and maintain large-scale data processing pipelines using Python and PySpark, in a Singapore banking environment.

You will design ETL pipelines with PySpark, Python and SQL, work with Big Data technologies, and ensure data quality, validation and error handling, while collaborating in Agile teams.

The role requires strong communication to manage stakeholders and translate business requirements into scalable technical solutions.