Software Engineer

REGTECH INSIGHT PTE. LTD.; Singapore; On-site; SGD 90,000 - 150,000; Full time

Job summary

REGTECH INSIGHT PTE. LTD. is seeking a data engineer with strong Python and PySpark skills to design, build, and maintain ETL pipelines for large-scale data processing.

The role focuses on developing data pipelines using PySpark, Python, and SQL, and involves working with Big Data technologies for data transformation and batch processing. The candidate should have a solid grounding in SQL, data modelling, and performance tuning, with a preference for experience on cloud/data platforms such as

Qualifications

• Strong hands-on experience in Python and PySpark development for large-scale data processing.
• Design, develop and maintain ETL/data pipelines using PySpark, Python and SQL.
• Experience working with Big Data technologies, data transformation and batch processing.
• Strong knowledge of SQL, data modelling, performance tuning and optimization.
• Experience with cloud/data platforms such as AWS, Azure, Databricks or equivalent is preferred.
• Good understanding of data quality, reconciliation, validation and error handling.
• Ability to analyse business requirements and translate them into scalable technical solutions.
• Experience working in Agile/Scrum environments with strong communication and stakeholder-management skills.

Responsibilities

• Design, develop and maintain ETL/data pipelines using PySpark, Python and SQL.
• Work with Big Data technologies for data transformation and batch processing.
• Analyse business requirements and translate them into scalable technical solutions.

Skills

Python

PySpark

SQL

Data modelling

Performance tuning

Agile

Stakeholder management

Tools

Databricks

AWS

Azure

Job description

Strong hands-on experience in Python and PySpark development for large-scale data processing.

Design, develop and maintain ETL/data pipelines using PySpark, Python and SQL.

Experience working with Big Data technologies, data transformation and batch processing.

Strong knowledge of SQL, data modelling, performance tuning and optimization.

Experience with cloud/data platforms such as AWS, Azure, Databricks or equivalent is preferred.

Good understanding of data quality, reconciliation, validation and error handling.

Ability to analyse business requirements and translate them into scalable technical solutions.

Experience working in Agile/Scrum environments with strong communication and stakeholder-management skills.

Candidates should be available to work in a Singapore-based banking environment.