Data Migration & Reporting Engineer

D L RESOURCES PTE LTD; Singapore; On-site; SGD 90,000 - 130,000; Full time

Job summary

D L RESOURCES PTE LTD in Singapore seeks a data engineer to support a strategic data migration and reporting transformation initiative. You will analyse legacy data processing, map sources to new data marts, redevelop scripts, validate outputs, and produce comprehensive data documentation using SAS, SQL, Python, Hive, Impala and Oozie.

The role requires strong analytical skills, experience with Hadoop-based platforms, and the ability to work with large datasets in enterprise environments.

Qualifications

• Strong SQL, SAS or Python scripting and data manipulation skills.
• Hands-on experience with Hue, Hive, Impala, Oozie.
• Experience in data warehousing, ETL development, data migration, or data engineering projects.
• Experience working with large and complex datasets.
• Strong understanding of relational databases and data modelling concepts.

Responsibilities

• Analyse existing tables, reports, datasets, and data processing workflows currently sourced from legacy data marts and manual processes.
• Review and understand existing scripts, transformation logic, data dependencies, and business rules.
• Identify data sources, data lineage, reporting requirements, and current-state processes.
• Engage business to understand existing reporting methodologies and requirements.
• Perform source-to-target mapping between legacy data marts/manual sources and new data marts.
• Analyse and document field mappings, transformation rules, calculations, and business logic.
• Identify gaps, inconsistencies, and opportunities for process optimisation during migration.
• Develop migration specifications and ensure alignment with business requirements.
• Develop, enhance, and maintain SQL scripts using Hive and Impala engines via Hue.
• Develop scripts for data extraction, transformation, validation, and reporting processes.
• Rebuild existing tables, reporting datasets, and data preparation processes using the new data marts as source systems.
• Configure and support workflow scheduling and automation using Oozie.
• Ensure developed solutions are scalable, efficient, and maintainable.
• Perform reconciliation and validation between outputs generated from current sources and outputs generated from the new data marts.
• Validate data accuracy, completeness, consistency, and timeliness.
• Investigate and resolve data discrepancies and defects identified during testing.
• Support User Acceptance Testing (UAT) and business validation activities.
• Ensure migrated reports and datasets meet defined business and technical requirements.

Skills

SQL

SAS

Python

Education

BSc/BE in CS/IS

Tools

Hue

Hive

Impala

Oozie

Job description

D L RESOURCES PTE LTD in Singapore seeks a data engineer to support a strategic data migration and reporting transformation initiative. You will analyse legacy data processing, map sources to new data marts, redevelop scripts, validate outputs, and produce comprehensive data documentation using SAS, SQL, Python, Hive, Impala and Oozie.

The role requires strong analytical skills, experience with Hadoop-based platforms, and the ability to work with large datasets in enterprise environments.