Python Pyspark Developer

Unison Group; Singapore; On-site; SGD 90,000 - 150,000; Full time

Job summary

Unison Group in Singapore is seeking a hands-on data engineer to design, develop and maintain large-scale data pipelines using Python, PySpark and SQL. You will translate business requirements into scalable ETL solutions, ensuring data quality and performance while working with Agile teams in a banking environment.

Experience with cloud platforms such as AWS, Azure and Databricks is preferred, along with strong stakeholder communication.

Qualifications

• Strong hands-on experience in Python and PySpark development for large-scale data processing.
• Design, develop and maintain ETL/data pipelines using PySpark, Python and SQL.
• Experience working with Big Data technologies, data transformation and batch processing.
• Strong knowledge of SQL, data modelling, performance tuning and optimization.
• Experience with cloud/data platforms such as AWS, Azure, Databricks or equivalent is preferred.
• Good understanding of data quality, reconciliation, validation and error handling.
• Ability to analyse business requirements and translate them into scalable technical solutions.
• Experience working in Agile/Scrum environments with strong communication and stakeholder-management skills.
• Candidates should be available to work in a Singapore-based banking environment.

Responsibilities

• Design, develop, and maintain data pipelines using PySpark, Python, and SQL.
• Transform business requirements into scalable ETL solutions for large-scale processing.
• Ensure data quality, reconciliation, validation and error handling across pipelines.
• Collaborate with Agile teams and stakeholders in a banking environment to deliver reliable data services.

Skills

Python

PySpark

SQL

ETL pipelines

Data modeling

Agile/Scrum

Stakeholder management

Tools

AWS

Azure

Databricks

Job description

• Strong hands-on experience in Python and PySpark development for large-scale data processing
• Design, develop and maintain ETL/data pipelines using PySpark, Python and SQL
• Experience working with Big Data technologies, data transformation and batch processing
• Strong knowledge of SQL, data modelling, performance tuning and optimization
• Experience with cloud/data platforms such as AWS, Azure, Databricks or equivalent is preferred
• Good understanding of data quality, reconciliation, validation and error handling
• Ability to analyse business requirements and translate them into scalable technical solutions
• Experience working in Agile/Scrum environments with strong communication and stakeholder-management skills
• Candidates should be available to work in a Singapore-based banking environment