Data Engineer (Data Platforms)

Optimum Solutions Pte Ltd; Singapore; On-site; SGD 90,000 - 150,000; Full time

Job summary

Optimum Solutions Pte Ltd in Singapore is seeking a hands-on Data Engineer to support a central data platform, collaborating with technical teams, data owners, and business users to deliver reliable pipelines and high‑quality datasets for reporting.

You will develop ETL/ELT pipelines, implement data quality checks, optimize performance, and provide documentation while translating business requirements into scalable data solutions.

Qualifications

• 3-4 years of data engineering experience with strong SQL and Python for data processing and pipelines.
• Hands-on ETL/ELT development including ingestion, transformation, validation and production support.
• Solid understanding of data modelling, data warehousing and relational/file-based data.
• Experience handling complex/legacy data, data reconciliation and root-cause analysis.
• AWS experience (S3/Athena/IAM) and cloud data platforms are a plus.
• Familiarity with Spark/Databricks and BI tools is advantageous.

Responsibilities

• Develop and maintain ETL/ELT pipelines and interfaces for data ingestion.
• Build SQL and Python solutions for data cleansing, transformation, standardisation and reconciliation.
• Maintain data models, datasets and processing logic to support new requirements.
• Implement data quality checks, investigate anomalies and resolve root causes.
• Monitor pipelines, rerun jobs and improve reliability and performance.
• Support testing, UAT, defect resolution and production issues.
• Develop governed datasets and data sources for downstream reporting and analytics.
• Translate business requirements into data mappings with clear documentation.
• Support data governance, audit, access review and compliance activities.

Skills

SQL

Python

ETL/ELT pipelines

Data cleansing

Data modelling

Data warehousing

Troubleshooting

Stakeholder management

Problem solving

Tools

Databricks

Spark

Tableau

AWS

S3

Athena

Job description

Our client is seeking a hands-on Data Engineer to support the operations, maintenance and enhancement of a central data platform. You will work closely with technical teams, source system owners, vendors and business users to build reliable data pipelines and deliver quality datasets for reporting and analytics.

Responsibilities

• Develop and maintain ETL/ELT pipelines and file-based interfaces for data ingestion.
• Build SQL and Python solutions for data cleansing, transformation, standardisation and reconciliation.
• Maintain data models, tables, datasets and processing logic to support new requirements.
• Implement data quality, validation and reconciliation checks, investigate anomalies and resolve root causes.
• Monitor and troubleshoot data pipelines, perform reruns and improve pipeline reliability and performance.
• Support system enhancements, testing, UAT, defect resolution and production issues.
• Develop governed datasets, queries and data sources for downstream reporting and analytics.
• Translate business requirements into data mappings and technical solutions, while maintaining clear documentation.
• Support data governance, audit, access review and compliance activities.

Requirements

• 3-4 years of relevant Data Engineering experience, with strong SQL and working proficiency in Python for data processing, automation and pipeline development.
• Hands‑on experience in ETL/data pipeline development, including data ingestion, transformation, validation and production support.
• Strong understanding of data modelling, data warehousing and relational/file-based data.
• Experience handling complex, inconsistent or legacy data, including data reconciliation, troubleshooting and root-cause analysis.
• AWS experience preferred, particularly S3, Athena, IAM, CSV/Parquet and partitioned datasets; experience with other cloud data platforms will also be considered.
• Experience with Spark, Databricks or similar technologies is an advantage.
• Experience with Tableau or other BI tools is a plus.
• Strong analytical, problem-solving and stakeholder management skills, with the ability to work independently and deliver quality work within timelines.