Senior Data Engineer

MetaComp; Kampung Malaysia Tambahan; In loco; MYR 180.000 - 240.000; Tempo pieno

Descrizione del lavoro

MetaComp is seeking a hands-on Senior Data Engineer to design, build and scale a modern data lakehouse and analytics platform. You will own data architecture, pipelines, modelling, quality, and platform reliability to enable trusted data for reporting, analytics, risk, compliance, and AI use cases.

You will collaborate with Engineering, Product, Finance, Operations, Risk, and Compliance to implement production-grade data solutions and governance, while driving performance and security across the

Competenze

• Bachelor's degree in CS or related field.
• 5+ years of data-engineering experience.
• Experience designing and operating production-grade data platforms.
• Hands-on with Doris, StarRocks, ClickHouse, Snowflake, Databricks or equivalent.
• Strong SQL and data modelling (dimensional/analytical).
• Proficiency in Python, Java or Scala.
• Experience with ETL/ELT, CDC, batch processing and real-time streaming.
• Experience with Spark, Flink, Kafka, Airflow, dbt, SeaTunnel or similar.
• Experience with AWS, Azure or GCP; AWS preferred.
• Fluent in English and Mandarin for collaboration with vendors/teams.

Mansioni

• Design scalable, secure cloud data lakehouse and analytics platform.
• Develop batch and real-time pipelines integrating databases, APIs, files, and event streams.
• Build production-grade ETL/ELT, CDC workflows with testing and monitoring.
• Design data models for reporting, reconciliation, analytics and BI.
• Optimize table design, storage, partitioning and query performance.
• Establish data quality, governance, lineage, metadata, access-control and retention standards.
• Support BI platforms and govern self-service analytics.
• Collaborate with Engineering, Product, Finance, Operations, Risk and Compliance teams.
• Maintain architecture docs, engineering standards and runbooks.

Conoscenze

SQL

Python

Java/Scala

Data pipeline design

Cloud platforms

Formazione

Bachelor's degree in Computer Science or related

Strumenti

Apache Doris

StarRocks

ClickHouse

Snowflake

Databricks

Kafka

Airflow

dbt

SeaTunnel

Descrizione del lavoro

MetaComp Pte Ltd is a leading Singapore-based digital payment solution provider, licensed and regulated by the Monetary Authority of Singapore (MAS) as a Major Payment Institution, to provide Digital Payment Token Services and Cross-border Payment Transfers. Operating under a P2B2C (platform-to-business, partners-to-clients) model, MetaComp provides its clients with an integrated end-to-end suite of services, empowering them to confidently enter the digital asset market with much-needed safety, security, and compliance assurance. Together with its parent company, Metaverse Green Exchange Pte. Ltd. (a MAS-licensed CMS holder permitted to carry out, inter alia, brokerage and custody services), MetaComp introduces its suite of services through CAMP (Client Assets Management Platform) which allow businesses to develop and scale their digital asset offerings through various products and/or services such as over-the-counter transactions, fiat payments, digital asset custody and prime brokerage.

Role Overview

We are looking for a hands-on Senior Data Engineer (Data Lakehouse & Analytics Platform) to build and scale our modern data platform. You will own data architecture, pipelines, modelling, quality, and platform reliability, enabling trusted data for reporting, analytics, risk, compliance, and AI use cases.

Key Responsibilities

• Design and build a scalable, secure cloud data lakehouse and analytics platform.
• Develop batch and real-time pipelines integrating databases, APIs, files, and event streams.
• Build production-grade ETL/ELT and CDC workflows with testing, monitoring, retries, and alerting.
• Design data models for reporting, reconciliation, operational analytics, and business intelligence.
• Optimize table design, storage, partitioning, materialized views, and query performance.
• Establish data-quality, governance, lineage, metadata, access-control, and retention standards.
• Support BI platforms and govern self-service analytics.
• Collaborate with Engineering, Product, Finance, Operations, Risk, and Compliance teams.
• Maintain architecture documentation, engineering standards, and operational runbooks.

Requirements

• Bachelor’s degree in Computer Science, Data Engineering, or a related discipline.
• At least 5 years of relevant data-engineering experience.
• Experience designing and operating production-grade data platforms.
• Hands-on experience with Apache Doris, StarRocks, ClickHouse, Snowflake, Databricks, or equivalent platforms.
• Strong SQL and experience with relational, dimensional, and analytical data modelling.
• Proficiency in Python, Java, or Scala.
• Experience with ETL/ELT, CDC, batch processing, and real-time streaming.
• Experience with Spark, Flink, Kafka, Airflow, dbt, SeaTunnel, or similar technologies.
• Experience with AWS, Azure, or GCP; AWS is preferred.
• Strong understanding of data quality, governance, security, and production operations.
• Professional proficiency in English and Mandarin for collaboration with Chinese-speaking vendors and technical teams.

Nice to Have

• Experience with Iceberg, Hudi, Delta Lake, or Trino.
• Experience with Kubernetes, Terraform, and Git-based CI/CD.
• Experience in fintech, payments, banking, blockchain, or digital assets.
• Knowledge of reconciliation, regulatory reporting, fraud, risk, or compliance analytics.
• Experience supporting machine-learning or AI data pipelines.

We are committed to creating an inclusive workplace where every individual feels respected, valued, and empowered to contribute. We celebrate diversity in all its forms—background, ethnicity, gender, identity, orientation, experience, and thought—and believe it strengthens our culture and our work. We are proud to be an equal opportunity employer and do not discriminate on the basis of race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, disability, or any other protected characteristic.