Software Engineer

Riskdata Consulting; Singapore; On-site; SGD 110,000 - 170,000; Full time

Job summary

Riskdata Consulting invites applications for a data engineering role focused on Python and PySpark development within a Singapore-based banking environment. You will design, build, and maintain ETL pipelines, transforming data with PySpark, Python and SQL to support large-scale processing.

The role requires hands-on experience with Big Data technologies, data transformation, and batch processing, plus strong SQL and data modelling skills.

Qualifications

• Hands-on experience in Python and PySpark for large-scale data processing.

Responsibilities

• Design, develop and maintain ETL/data pipelines using PySpark, Python and SQL.
• Translate business requirements into scalable technical solutions.
• Collaborate in Agile/Scrum environments with stakeholders.
• Work in a Singapore-based banking environment.

Skills

Python

PySpark

SQL

Data modelling

Performance tuning

Big Data

Agile/Scrum

Stakeholder management

Data quality

Data reconciliation

Data validation

Tools

Databricks

AWS

Azure

SQL

Job description

Strong hands-on experience in Python and PySpark development for large-scale data processing.

Design, develop and maintain ETL/data pipelines using PySpark, Python and SQL.

Experience working with Big Data technologies, data transformation and batch processing.

Strong knowledge of SQL, data modelling, performance tuning and optimization.

Experience with cloud/data platforms such as AWS, Azure, Databricks or equivalent is preferred.

Good understanding of data quality, reconciliation, validation and error handling.

Ability to analyse business requirements and translate them into scalable technical solutions.

Experience working in Agile/Scrum environments with strong communication and stakeholder-management skills.

Candidates should be available to work in a Singapore-based banking environment.