Data Platform Engineer - Pipelines & Quality

OPTIMUM SOLUTIONS (SINGAPORE) PTE LTD; Singapore; On-site; SGD 90,000 - 130,000; Full time

Job summary

OPTIMUM SOLUTIONS (SINGAPORE) PTE LTD is seeking a hands-on Data Engineer to support a central data platform, collaborating with technical teams, data owners and business users to deliver reliable pipelines and quality datasets for reporting.

You will build ETL/ELT pipelines, write SQL and Python for cleansing and transformation, maintain data models, monitor pipelines and contribute to data governance and documentation.

Qualifications

• 3-4 years of relevant Data Engineering experience.
• Strong SQL and Python for data processing and pipelines.
• Experience in ETL/data pipeline development and data ingestion.
• Knowledge of data modelling, data warehousing and relational/file data.
• AWS experience preferred (S3, Athena, IAM) and partitioned data.

Responsibilities

• Develop and maintain ETL/ELT pipelines and file-based interfaces for data ingestion.
• Build SQL and Python solutions for data cleansing, transformation, standardisation and reconciliation.
• Maintain data models, tables, datasets and processing logic to support new requirements.
• Implement data quality, validation and reconciliation checks, investigate anomalies and resolve root causes.
• Monitor and troubleshoot data pipelines, perform reruns and improve pipeline reliability and performance.
• Support system enhancements, testing, UAT, defect resolution and production issues.
• Develop governed datasets, queries and data sources for downstream reporting and analytics.
• Translate business requirements into data mappings and technical solutions, while maintaining clear documentation.
• Support data governance, audit, access review and compliance activities.

Skills

SQL

Python

ETL/ELT pipelines

Data modelling

Data warehousing

Data quality checks

AWS (S3/Athena/IAM)

Spark/Databricks

BI tools (Tableau)

Tools

Databricks

Tableau

Job description

OPTIMUM SOLUTIONS (SINGAPORE) PTE LTD is seeking a hands-on Data Engineer to support a central data platform, collaborating with technical teams, data owners and business users to deliver reliable pipelines and quality datasets for reporting.

You will build ETL/ELT pipelines, write SQL and Python for cleansing and transformation, maintain data models, monitor pipelines and contribute to data governance and documentation.