Software Engineer

UNISONEDGE CONSULTING PTE. LTD.; Singapore; On-site; SGD 90,000 - 130,000; Full time

Job summary

UNISONEDGE CONSULTING PTE. LTD. is seeking a data engineer with hands-on expertise in Python and PySpark to design and maintain large-scale data pipelines. The role focuses on ETL development, data modelling, and performance tuning within a Singapore-based banking environment.

The ideal candidate will have strong SQL skills, experience with cloud platforms (AWS/Azure/Databricks), and Agile/Scrum familiarity to collaborate effectively with stakeholders and deliver scalable data solutions.

Qualifications

• Strong hands-on experience in Python and PySpark development for large-scale data processing.
• Design, develop, and maintain ETL/data pipelines using PySpark, Python, and SQL.
• Experience with big data technologies, data transformation, and batch processing.
• Strong knowledge of SQL, data modelling, performance tuning and optimization.
• Experience with cloud/data platforms such as AWS, Azure, Databricks, or equivalent is preferred.
• Good understanding of data quality, reconciliation, validation, and error handling.
• Ability to analyze business requirements and translate them into scalable technical solutions.
• Experience working in Agile/Scrum environments with strong communication and stakeholder-management skills.
• Candidates should be available to work in a Singapore-based banking environment.

Responsibilities

• Design and implement scalable data pipelines and ETL processes.
• Optimize data models and SQL queries for performance.
• Collaborate with stakeholders to translate business needs into technical solutions.
• Maintain data quality and validation throughout processing pipelines.
• Participate in Agile/Scrum ceremonies and deliver in sprints.

Skills

Python

PySpark

SQL

data modelling

performance tuning

data quality

stakeholder management

Agile/Scrum

communication

Tools

Databricks

AWS

Azure

Job description

Job Description:

• Strong hands-on experience in Python and PySpark development for large-scale data processing.
• Design, develop, and maintain ETL/data pipelines using PySpark, Python, and SQL.
• Experience working with big data technologies, data transformation, and batch processing.
• Strong knowledge of SQL, data modelling, performance tuning and optimization.
• Experience with cloud/data platforms such as AWS, Azure, Databricks, or equivalent is preferred.
• Good understanding of data quality, reconciliation, validation, and error handling.
• Ability to analyze business requirements and translate them into scalable technical solutions.
• Experience working in Agile/Scrum environments with strong communication and stakeholder-management skills.
• Candidates should be available to work in a Singapore-based banking environment.