Data Migration Engineer

Astek Singapore Innovation Technology; Singapore; On-site; SGD 70,000 - 100,000; Full time

Job summary

A technology solutions company in Singapore is seeking a skilled Data Migration Engineer to lead end-to-end data migration initiatives. The ideal candidate should possess strong experience in data migration, ETL processes, and data engineering, with proficiency in Python and SQL. Responsibilities include designing ETL pipelines, validating data, and optimizing migration performance. This role requires managing multiple projects with attention to detail, ensuring data integrity throughout the process.

Qualifications

• 3-8 years of relevant experience.
• Strong experience in data migration and ETL processes.
• Proficient in Python and SQL for scripting and transformation.
• Experience with data validation and quality assurance.
• Ability to manage multiple migration projects under tight timelines.

Responsibilities

• Lead data migration initiatives from legacy systems to modern platforms.
• Analyze legacy data structures and profile source data for quality issues.
• Design and maintain scalable ETL pipelines for data extraction.
• Conduct trial runs to validate data accuracy and perform reconciliations.
• Monitor performance of migration tasks and troubleshoot bottlenecks.

Skills

Data migration

ETL processes

Data engineering

Python

SQL

Data validation

Data reconciliation

Data profiling tools

Relational databases

Web services

Job description

We are seeking a skilled Data Migration Engineer to lead and execute end-to-end data migration initiatives from legacy systems to modern platforms. The ideal candidate will have hands‑on experience in ETL pipelines, data engineering, and data validation, with strong proficiency in Python and SQL. You will be responsible for ensuring the accuracy, completeness, and integrity of data throughout the migration lifecycle, while minimizing disruption to business operations.

Key Responsibilities

1. Migration Planning and Analysis

• Analyze legacy data structures, formats, and dependencies.
• Profile source data to identify quality issues and inconsistencies.
• Work closely with business and technical stakeholders to define migration scope, timelines, and cutover/rollback strategies.
• Translate business requirements into migration plans and technical specifications.

2. ETL Development and Execution

• Design, develop, and maintain scalable ETL pipelines for data extraction, transformation, and loading.
• Cleanse, map, and transform data to align with the schema and constraints of the target system.
• Execute both incremental and full data loads with minimal downtime.
• Ensure data consistency, referential integrity, and format alignment during migration.

3. Validation, Testing, and Reconciliation

• Conduct trial runs and dry migrations to validate data accuracy and completeness.
• Develop and perform data reconciliation between source and target systems to ensure parity.
• Implement robust error‑handling, logging, and rollback mechanisms.
• Investigate and resolve discrepancies or failed loads.

4. Performance Tuning and Optimization

• Monitor performance of data migration tasks and troubleshoot bottlenecks.
• Tune queries, scripts, and pipelines to support large‑volume data transfers efficiently.
• Ensure compliance with data governance, privacy, and security policies throughout the migration.

Requirements:

Requirements

• 3-8 years of relevant experience
• Strong experience in data migration, ETL processes, and data engineering practices.
• Proficient in Python and SQL for scripting, transformation, and automation.
• Experience with data validation, reconciliation, and quality assurance
• Hands‑on with data profiling tools
• Experience working with relational databases (e.g., MySQL, PostgreSQL, MS SQL Server, Oracle).
• Possess good understanding of object‑oriented concepts, design patterns, concurrency and software techniques.
• Experience in application integration, monitoring and control with exposure in automated tests.
• Proficient in Web services, API technologies and concepts.
• Ability to manage multiple migration projects under tight timelines with high attention to detail.
• Strong analytical and problem‑solving skills.
• Proficient in consuming data from a variety of sources and connecting frontend applications to backend services.
• Good in analyzing requirements, creating technical specifications and using test cases and scenarios.