Senior Data Engineer

PIXELATE EVERYTHING; Puchong; On-site; MYR 100,000 - 150,000; Full time

Job summary

A technology company is seeking a highly skilled Data Engineer to support its Marketing & Analytics Department in Puchong, Malaysia. This role focuses on developing robust data pipelines, ensuring data quality, and automating reporting workflows. The ideal candidate will have strong experience with ClickHouse and data streaming technologies, proficiency in SQL and Python, and familiarity with modern data integration practices. The company offers flexible working hours and comprehensive medical benefits.

Benefits

Flexi Working Hours

Medical, Optical and Dental Benefits

Body Screening and Insurance Claims

Qualifications

• Strong experience with ClickHouse or willingness to switch from other data warehouses.
• Hands-on experience with data streaming technologies.
• Proficiency in advanced SQL queries and optimization techniques.
• Experience building data pipelines and integrating analytics tools.
• Proficiency in Python for automation tasks.

Responsibilities

• Build and maintain ETL/ELT pipelines for analytics data.
• Design and manage ClickHouse schemas and optimize performance.
• Validate data and ensure high levels of data quality.
• Automate reporting workflows and integrate tracking tools.
• Develop APIs or microservices for data sharing.

Skills

ClickHouse

Kafka

SQL

Python

Airflow

Tools

dbt

Prefect

Job description

We are looking for a highly skilled Data Engineer to support the Marketing & Analytics Department. This role focuses on building robust data pipelines, ensuring data quality, enabling accurate analytics, and supporting high-volume data operations across marketing, product, and BI use cases.

Responsibilities

• Data Pipeline Development
  • Build and maintain ETL/ELT pipelines for marketing, product, and user analytics data.
  • Implement real-time streaming pipelines using Kafka, Redpanda, Pulsar, or equivalent.
  • Integrate data from multiple platforms (GA4, GTM, ad platforms, CRM, tracking systems).
  • Ensure scalable ingestion into ClickHouse or other columnar databases.
• Data Infrastructure & Storage
  • Design and manage ClickHouse schemas, tables, materialized views, and optimizations.
  • Maintain data warehouse performance, partitioning, compression, and cost efficiency.
  • Implement data retention policies and optimize for high-volume event data.
• Data Quality & Governance
  • Work closely with Marketing Data Analysts to support accurate event tracking.
  • Validate incoming data, perform QA on new fields/events, maintain consistency.
  • Establish naming conventions, data dictionary, and governance rules.
  • Monitor pipelines and ensure high system uptime & data accuracy.
• Data Integration & Automation
  • Build connectors between tracking tools (GA4, PostHog, Mixpanel, Amplitude) and warehouse.
  • Automate marketing and product reporting workflows.
  • Support ingestion of pixel tracking data, ad conversions, campaign performance metrics.
  • Develop APIs or microservices for data sharing across internal systems.

Required Skillset

• Must‑Have (At Least 5)
  • Strong experience with ClickHouse (or Redshift/BigQuery/Snowflake with willingness to switch).
  • Hands‑on experience with data streaming (Kafka, Redpanda, Kinesis, Pulsar).
  • Proficiency in SQL (advanced queries, window functions, optimization).
  • Experience building pipelines using tools like Airflow, dbt, Prefect, or custom scripts.
  • Experience integrating with marketing + product analytics tools (GA4, GTM, tracking SDKs).
  • Proficiency in Python for ETL, API ingestion, and automation.
  • Understanding of event‑driven data models (events, properties, sessions, users).
  • Experience with version control (Git) and CI/CD workflows for data.
• Good‑to‑Have (Bonus Skills)
  • Experience with ClickHouse cluster administration (replication, sharding).
  • Knowledge of marketing metrics (ROAS, CAC, LTV, attribution).
  • Familiarity with BI tools (Tableau, Looker, Power BI, Metabase).
  • Experience in fintech, ad‑tech, or other high‑volume tracking environments.
  • Familiarity with tracking QA tools, SDK instrumentation, or tag management.

Benefits

• Flexi Working Hours
• Medical, Optical and Dental Benefits
• Body Screening and Insurance Claims