Senior Data Engineer: Build Trusted Data Pipelines

5G-Starlink Pte.; Malacca City; On-site; MYR 150,000 - 210,000; Full time

Job summary

Deriv seeks a Senior Data Engineer to define future data models and pipelines. You will leverage GCP, Airflow, Python, Docker, and PostgreSQL to deliver dependable BI solutions. Build, test, and maintain ETL/ELT architectures and ensure trustworthy data warehouses for analytics.

You will extract from diverse sources, maintain data integrity, and enable data-driven business decisions through scalable pipelines and modern storage formats.

Qualifications

• Minimum 5 years in data engineering.
• Experience with Kimball star schema, Anchor modelling or Data Vault.
• Proficient in Python for data processing.
• Strong SQL and NoSQL skills, preferably PostgreSQL.
• Familiarity with data warehouses and columnar storage.
• Hands-on with GCP services and ETL/ELT pipelines.

Responsibilities

• Design, build and maintain data pipelines and data warehouse.
• Ensure data integrity and security across sources.
• Develop scalable ETL/ELT architectures using Airflow.
• Translate data into actionable business insights for analyses.
• Collaborate with data analysts and data scientists.
• Stay updated on product releases impacting data models.

Skills

Data modelling

Python

SQL/NoSQL

ETL/ELT

Airflow

GCP

Data warehousing

Communication

English proficiency

Education

5+ years experience in data engineering

Tools

PostgreSQL

Airflow

Docker

BigQuery

Redshift

Parquet

Pg_basebackup

WAL archival

Job description

Deriv seeks a Senior Data Engineer to define future data models and pipelines. You will leverage GCP, Airflow, Python, Docker, and PostgreSQL to deliver dependable BI solutions. Build, test, and maintain ETL/ELT architectures and ensure trustworthy data warehouses for analytics.

You will extract from diverse sources, maintain data integrity, and enable data-driven business decisions through scalable pipelines and modern storage formats.