Data Engineer (Data Platforms)

OPTIMUM SOLUTIONS (SINGAPORE) PTE LTD; Singapore; On-site; SGD 90,000 - 130,000; Full time

Job summary

OPTIMUM SOLUTIONS (SINGAPORE) PTE LTD is seeking a hands-on Data Engineer to support a central data platform, collaborating with technical teams, data owners and business users to deliver reliable pipelines and quality datasets for reporting.

You will build ETL/ELT pipelines, write SQL and Python for cleansing and transformation, maintain data models, monitor pipelines and contribute to data governance and documentation.

Qualifications

• 3-4 years of relevant Data Engineering experience.
• Strong SQL and Python for data processing and pipelines.
• Experience in ETL/data pipeline development and data ingestion.
• Knowledge of data modelling, data warehousing and relational/file data.
• AWS experience preferred (S3, Athena, IAM) and partitioned data.

Responsibilities

• Develop and maintain ETL/ELT pipelines and file-based interfaces for data ingestion.
• Build SQL and Python solutions for data cleansing, transformation, standardisation and reconciliation.
• Maintain data models, tables, datasets and processing logic to support new requirements.
• Implement data quality, validation and reconciliation checks, investigate anomalies and resolve root causes.
• Monitor and troubleshoot data pipelines, perform reruns and improve pipeline reliability and performance.
• Support system enhancements, testing, UAT, defect resolution and production issues.
• Develop governed datasets, queries and data sources for downstream reporting and analytics.
• Translate business requirements into data mappings and technical solutions, while maintaining clear documentation.
• Support data governance, audit, access review and compliance activities.

Skills

SQL

Python

ETL/ELT pipelines

Data modelling

Data warehousing

Data quality checks

AWS (S3/Athena/IAM)

Spark/Databricks

BI tools (Tableau)

Tools

Databricks

Tableau

Job description

Our client is seeking a hands‑on Data Engineer to support the operations, maintenance and enhancement of a central data platform. You will work closely with technical teams, source system owners, vendors and business users to build reliable data pipelines and deliver quality datasets for reporting and analytics.

Responsibilities

• Develop and maintain ETL/ELT pipelines and file-based interfaces for data ingestion.
• Build SQL and Python solutions for data cleansing, transformation, standardisation and reconciliation.
• Maintain data models, tables, datasets and processing logic to support new requirements.
• Implement data quality, validation and reconciliation checks, investigate anomalies and resolve root causes.
• Monitor and troubleshoot data pipelines, perform reruns and improve pipeline reliability and performance.
• Support system enhancements, testing, UAT, defect resolution and production issues.
• Develop governed datasets, queries and data sources for downstream reporting and analytics.
• Translate business requirements into data mappings and technical solutions, while maintaining clear documentation.
• Support data governance, audit, access review and compliance activities.

Requirements

• 3-4 years of relevant Data Engineering experience, with strong SQL and working proficiency in Python for data processing, automation and pipeline development.
• Hands‑on experience in ETL/data pipeline development, including data ingestion, transformation, validation and production support.
• Strong understanding of data modelling, data warehousing and relational/file-based data.
• Experience handling complex, inconsistent or legacy data, including data reconciliation, troubleshooting and root‑cause analysis.
• AWS experience preferred, particularly S3, Athena, IAM, CSV/Parquet and partitioned datasets; experience with other cloud data platforms will also be considered.
• Experience with Spark, Databricks or similar technologies is an advantage.
• Experience with Tableau or other BI tools is a plus.