Data Engineer

Idataraya Sdn Bhd; Kuala Lumpur; On-site; MYR 120,000 - 180,000; Full time

Job summary

Idataraya Sdn Bhd in Kuala Lumpur is seeking a data engineer to build ingestion and transformation pipelines from operational systems and model the warehouse to answer business questions.

You will keep pipelines observable to detect failures early and collaborate with analysts to interpret what the numbers mean, ensuring the data supports decision making.

Qualifications

• Commercial experience building data pipelines and warehouse models.
• Strong SQL and comfort with at least one orchestration tool.
• Understanding of incremental loads, late data and idempotency.
• Interest in the operational side, not only the data.

Responsibilities

• Build ingestion and transformation pipelines from operational systems.
• Model the warehouse for how the business actually asks questions.
• Keep pipelines observable, so failures are noticed by us and not by the client.
• Work with analysts on what the numbers should mean.

Skills

SQL

Data pipelines

Warehouse modeling

Orchestration tools

Observability

Tools

Airflow

Job description

You build the pipelines and warehouse models that client reporting runs on. The sources are operational systems we also build, so you can usually go and fix the cause.

What you will do

• Build ingestion and transformation pipelines from operational systems.
• Model the warehouse for how the business actually asks questions.
• Keep pipelines observable, so failures are noticed by us and not by the client.
• Work with analysts on what the numbers should mean.

What you will bring

• Commercial experience building data pipelines and warehouse models.
• Strong SQL and comfort with at least one orchestration tool.
• Understanding of incremental loads, late data and idempotency.
• Interest in the operational side, not only the data.