Senior Data Engineer

MetaComp; Kuala Lumpur; On-site; MYR 479,000 - 607,000; Full time

Job summary

MetaComp Pte Ltd, a Singapore-based digital payment solution provider, is seeking a hands-on Senior Data Engineer to design and scale a modern data lakehouse and analytics platform. You will own data architecture, pipelines, modelling, quality, and platform reliability to enable trusted data for reporting, analytics, risk, compliance, and AI use cases.

The role collaborates with Engineering, Product, Finance, Operations, Risk, and Compliance, building scalable batch and real-time pipelines,

Qualifications

• Bachelor’s degree in Computer Science, Data Engineering, or a related discipline.
• At least 5 years of relevant data-engineering experience.
• Hands-on experience with production-grade data platforms.
• Strong SQL and data modelling skills.
• Experience with ETL/ELT, CDC, batch processing, and real-time streaming.

Responsibilities

• Design and build a scalable, secure cloud data lakehouse and analytics platform.
• Develop batch and real-time pipelines integrating databases, APIs, files, and event streams.
• Build production-grade ETL/ELT and CDC workflows with testing, monitoring, retries, and alerting.
• Design data models for reporting, reconciliation, operational analytics, and business intelligence.
• Collaborate with Engineering, Product, Finance, Operations, Risk, and Compliance teams.
• Maintain architecture documentation, engineering standards, and operational runbooks.

Skills

SQL

Python/Java/Scala

Data modelling

Cloud platforms

Education

Bachelor’s degree in Computer Science/Data Engineering

Tools

Apache Doris

StarRocks

ClickHouse

Snowflake

Databricks

Spark

Job description

MetaComp Pte Ltd is a leading Singapore-based digital payment solution provider, licensed and regulated by the Monetary Authority of Singapore (MAS) as a Major Payment Institution, to provide Digital Payment Token Services and Cross-border Payment Transfers. Operating under a P2B2C (platform-to-business, partners-to-clients) model, MetaComp provides its clients with an integrated end-to-end suite of services, empowering them to confidently enter the digital asset market with much-needed safety, security, and compliance assurance. Together with its parent company, Metaverse Green Exchange Pte. Ltd. (a MAS-licensed CMS holder permitted to carry out, inter alia, brokerage and custody services), MetaComp introduces its suite of services through CAMP (Client Assets Management Platform) which allow businesses to develop and scale their digital asset offerings through various products and/or services such as over-the-counter transactions, fiat payments, digital asset custody and prime brokerage.

Role Overview

We are looking for a hands-on Senior Data Engineer (Data Lakehouse & Analytics Platform) to build and scale our modern data platform. You will own data architecture, pipelines, modelling, quality, and platform reliability, enabling trusted data for reporting, analytics, risk, compliance, and AI use cases.

Key Responsibilities

• Design and build a scalable, secure cloud data lakehouse and analytics platform.
• Develop batch and real-time pipelines integrating databases, APIs, files, and event streams.
• Build production-grade ETL/ELT and CDC workflows with testing, monitoring, retries, and alerting.
• Design data models for reporting, reconciliation, operational analytics, and business intelligence.
• Optimize table design, storage, partitioning, materialized views, and query performance.
• Establish data-quality, governance, lineage, metadata, access-control, and retention standards.
• Support BI platforms and govern self-service analytics.
• Collaborate with Engineering, Product, Finance, Operations, Risk, and Compliance teams.
• Maintain architecture documentation, engineering standards, and operational runbooks.

Requirements

• Bachelor’s degree in Computer Science, Data Engineering, or a related discipline.
• At least 5 years of relevant data-engineering experience.
• Experience designing and operating production-grade data platforms.
• Hands-on experience with Apache Doris, StarRocks, ClickHouse, Snowflake, Databricks, or equivalent platforms.
• Strong SQL and experience with relational, dimensional, and analytical data modelling.
• Proficiency in Python, Java, or Scala.
• Experience with ETL/ELT, CDC, batch processing, and real-time streaming.
• Experience with Spark, Flink, Kafka, Airflow, dbt, SeaTunnel, or similar technologies.
• Experience with AWS, Azure, or GCP; AWS is preferred.
• Strong understanding of data quality, governance, security, and production operations.
• Professional proficiency in English and Mandarin for collaboration with Chinese-speaking vendors and technical teams.

Nice to Have

• Experience with Iceberg, Hudi, Delta Lake, or Trino.
• Experience with Kubernetes, Terraform, and Git-based CI/CD.
• Experience in fintech, payments, banking, blockchain, or digital assets.
• Knowledge of reconciliation, regulatory reporting, fraud, risk, or compliance analytics.
• Experience supporting machine-learning or AI data pipelines.

We are committed to creating an inclusive workplace where every individual feels respected, valued, and empowered to contribute. We celebrate diversity in all its forms—background, ethnicity, gender, identity, orientation, experience, and thought—and believe it strengthens our culture and our work. We are proud to be an equal opportunity employer and do not discriminate on the basis of race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, disability, or any other protected characteristic.