Senior Data Engineer - Cloud Lakehouse & Real-Time Analytics

MetaComp; Kampung Malaysia Tambahan; On-site; MYR 180,000 - 240,000; Full time

Job summary

MetaComp is seeking a hands-on Senior Data Engineer to design, build and scale a modern data lakehouse and analytics platform. You will own data architecture, pipelines, modelling, quality, and platform reliability to enable trusted data for reporting, analytics, risk, compliance, and AI use cases.

You will collaborate with Engineering, Product, Finance, Operations, Risk, and Compliance to implement production-grade data solutions and governance, while driving performance and security across the

Qualifications

• Bachelor's degree in CS or related field.
• 5+ years of data-engineering experience.
• Experience designing and operating production-grade data platforms.
• Hands-on with Doris, StarRocks, ClickHouse, Snowflake, Databricks or equivalent.
• Strong SQL and data modelling (dimensional/analytical).
• Proficiency in Python, Java or Scala.
• Experience with ETL/ELT, CDC, batch processing and real-time streaming.
• Experience with Spark, Flink, Kafka, Airflow, dbt, SeaTunnel or similar.
• Experience with AWS, Azure or GCP; AWS preferred.
• Fluent in English and Mandarin for collaboration with vendors/teams.

Responsibilities

• Design scalable, secure cloud data lakehouse and analytics platform.
• Develop batch and real-time pipelines integrating databases, APIs, files, and event streams.
• Build production-grade ETL/ELT, CDC workflows with testing and monitoring.
• Design data models for reporting, reconciliation, analytics and BI.
• Optimize table design, storage, partitioning and query performance.
• Establish data quality, governance, lineage, metadata, access-control and retention standards.
• Support BI platforms and govern self-service analytics.
• Collaborate with Engineering, Product, Finance, Operations, Risk and Compliance teams.
• Maintain architecture docs, engineering standards and runbooks.

Skills

SQL

Python

Java/Scala

Data pipeline design

Cloud platforms

Education

Bachelor's degree in Computer Science or related

Tools

Apache Doris

StarRocks

ClickHouse

Snowflake

Databricks

Kafka

Airflow

dbt

SeaTunnel

Job description

MetaComp is seeking a hands-on Senior Data Engineer to design, build and scale a modern data lakehouse and analytics platform. You will own data architecture, pipelines, modelling, quality, and platform reliability to enable trusted data for reporting, analytics, risk, compliance, and AI use cases.

You will collaborate with Engineering, Product, Finance, Operations, Risk, and Compliance to implement production-grade data solutions and governance, while driving performance and security across the