Senior Data Engineer

Encora Technologies Sdn Bhd; Kuala Lumpur; On-site; MYR 80,000 - 120,000; Full time

Job summary

A data engineering firm in Kuala Lumpur is looking for a Senior Data Engineer with extensive expertise in SQL and ETL processes. The role involves designing and optimizing data pipelines, migrating data across systems, and ensuring high-quality standards. Ideal candidates should have strong proficiency in SQL and tools like PostgreSQL and Informatica, along with hands-on experience in data transformation and API integration. This position offers a dynamic work environment focusing on enterprise data solutions.

Qualifications

• 6–7 years of strong SQL proficiency with complex SQL queries.
• 3+ years in SQL optimization within large-scale data environments.
• 6–7 years of ETL development experience with relevant tools.
• 6–7 years in database engineering with PostgreSQL or Oracle.
• 5+ years in data migration between heterogeneous systems.
• 5+ years of experience in data transformation focusing on data quality.
• 3+ years of REST API integration experience.

Responsibilities

• Design, develop, and optimize data pipelines and ETL workflows.
• Write complex SQL queries and performance-optimized transformations.
• Maintain data views and database objects for optimal query execution.
• Lead data migration initiatives across various systems.
• Implement data transformation logic for business rules.
• Integrate external data sources through RESTful APIs.
• Ensure data quality and consistency across environments.
• Participate in cut-over planning and deployment.

Skills

SQL Proficiency

ETL Development

Database Engineering

Data Migration

REST API Integration

Data Transformation

Tools

PostgreSQL

Oracle

Informatica

Datastage

ODI

Job description

Overview

We are seeking a highly skilled Senior Data Engineer with strong expertise in SQL development, ETL processes, database optimization, and enterprise data integration. The ideal candidate has hands-on experience working with large datasets, optimizing performance, and enabling data flows across heterogeneous systems and platforms.

Key Responsibilities

• Design, develop, and optimize robust data pipelines and ETL workflows.
• Write complex SQL queries, stored procedures, and performance-optimized transformations across large datasets.
• Develop and maintain data views, schemas, indexing strategies, and database objects for optimal query execution.
• Lead and execute data migration initiatives across heterogeneous systems (on-prem, cloud, legacy, modern).
• Implement data transformation logic to support business rules, data enrichment, cleansing, and aggregation.
• Integrate external data sources through RESTful APIs, including authentication, pagination, error handling, and ingestion orchestration.
• Collaborate with cross-functional teams to ensure data models, pipelines, and integrations support analytical and operational requirements.
• Ensure data quality, consistency, reconciliation, and validation across environments.
• Participate in cut-over planning, testing cycles, and controlled deployment processes.
• Contribute to data governance, metadata management, and technical documentation.

Required Skills & Experience

• Strong SQL Proficiency (6–7 years)
  • Expert in complex SQL queries (joins, subqueries, window functions, stored procedures).
  • Hands-on experience with performance tuning and handling large datasets.
• SQL Optimization (3+ years)
  • Demonstrated experience optimizing database queries and improving performance across large-scale data environments.
• ETL Development (6–7 years)
  • Experience with ETL tools such as Informatica, Datastage, or ODI (any is acceptable).
• Database Engineering (6–7 years)
  • Must have: PostgreSQL and/or Oracle experience including:
  • schema design
  • views
  • indexing
  • stored procedures
  • database optimization
• Data Migration (5+ years)
  • Experience migrating data between heterogeneous systems (on-prem to cloud, legacy to modern).
  • Involvement in validation, reconciliation, testing, and cut-over planning.
• Data Transformation (5+ years)
  • Experience implementing complex transformation rules with focus on data consistency, cleansing, enrichment, and aggregation.
• REST API Integration (3+ years)
  • Experience consuming REST APIs for data ingestion.
  • Ability to handle authentication (OAuth/API Keys), pagination, rate limits, JSON parsing, and error handling.
  • Bonus: Exposure to building lightweight REST APIs to expose curated datasets.