Senior Data Engineer – Real-Time FinTech Pipelines

Deriv.com; Kuala Lumpur; On-site; MYR 180,000 - 240,000; Full time

Job summary

Deriv is seeking an experienced Data Engineer to design and operate end-to-end data pipelines powering trading decisions, product analytics, and AI/ML systems. You will own data accuracy across batch and streaming workloads, define data contracts, and enforce governance in a regulated financial setting.

You’ll optimize warehouse performance, implement schema evolution controls, and collaborate with analytics, product, and compliance teams to deliver reliable data products.

Qualifications

• 6+ years in data engineering, focusing on on-time data delivery and schema fidelity.
• Experience with regulated data environments and governance practices is a strong plus.
• Proficient in designing scalable data architectures and end-to-end data contracts.

Responsibilities

• Design and build ETL/ELT pipelines across batch and real-time workloads using AI-assisted development.
• Ensure observability: freshness checks, lineage tracking, anomaly detection, and governance built-in.
• Own data accuracy, define data contracts, and manage PII and access controls in a regulated financial environment.
• Improve warehouse performance and cost, and design scalable data models.

Skills

Data Engineering

SQL

Python

BigQuery

Airflow

dbt/Dataform

Data Modeling

ETL/ELT

Data Quality

Tools

GCP

BigQuery

Airflow

Python

dbt / Dataform

Kafka

Pub/Sub

Job description

Deriv is seeking an experienced Data Engineer to design and operate end-to-end data pipelines powering trading decisions, product analytics, and AI/ML systems. You will own data accuracy across batch and streaming workloads, define data contracts, and enforce governance in a regulated financial setting.

You’ll optimize warehouse performance, implement schema evolution controls, and collaborate with analytics, product, and compliance teams to deliver reliable data products.