Data Engineer

Aditya Consulting; Shah Alam; On-site; MYR 100,000 - 150,000; Full time

Job summary

A leading consulting firm in Malaysia is seeking a seasoned Data Engineer to design and scale data platforms that drive intelligence. This role involves managing complex datasets and ensuring their quality, and it suits someone passionate about data challenges. Candidates should have 5–10 years of experience, proficiency in SQL and NoSQL, and advanced skills in cloud data platforms like Snowflake and BigQuery. Join a company with excellent career development opportunities and a proven success record.

Benefits

Leadership Role

Excellent career development opportunities

Solid track record of success

Qualifications

• 5–10 years of experience in data engineering, preferably within telecom, digital, or large‑scale enterprise environments.
• Hands‑on experience with large, complex datasets such as Call Detail Records (CDRs) or network logs.
• Certification in CDMP or related data management credentials is a plus.

Responsibilities

• Design, build, and optimize end‑to‑end data pipelines across multiple environments.
• Architect and maintain robust data models across various domains.
• Manage and integrate data from diverse sources including data lakes and warehouses.
• Implement data validation, deduplication, and reconciliation frameworks.
• Collaborate closely with data scientists and business teams to deliver clean datasets.
• Monitor and fine‑tune pipeline performance for efficiency.

Skills

SQL

NoSQL

Cloud data platforms

Data governance

Problem-solving

Communication

Education

Bachelor’s or Master’s degree in Computer Science

Tools

Snowflake

BigQuery

Databricks

Hadoop

Job description

Note: Candidates should be based in Malaysia.

About the Role

We’re looking for a seasoned Data Engineer who can design, build, and scale data platforms that power intelligent decision‑making. You’ll play a key role in managing complex datasets, ensuring data quality, and driving the evolution of our enterprise data infrastructure. This role is ideal for someone who enjoys solving data challenges at scale and working at the intersection of business and technology.

Key Responsibilities

• Design, build, and optimize end‑to‑end data pipelines across multiple environments (on‑prem, cloud, hybrid).
• Architect and maintain robust data models across domains such as customer, product, network, and usage.
• Manage and integrate data from diverse sources — including data lakes, warehouses, and lakehouses (Snowflake, BigQuery, Hadoop, Databricks, etc.).
• Implement data validation, deduplication, and reconciliation frameworks to ensure data accuracy and reliability.
• Maintain compliance with global data privacy and telecom regulations (GDPR, PDPA, CCPA).
• Collaborate closely with data scientists, analysts, and business teams to deliver clean and trusted datasets.
• Monitor and fine‑tune pipeline performance for latency, throughput, and cost efficiency in both batch and streaming environments.
• Drive automation of data operations, including deployment, testing, and monitoring.
• Evaluate and adopt emerging tools in data engineering and real‑time processing.
• Contribute to the ongoing evolution of our data architecture — including modernization, cloud migration, and event‑driven systems.

Ideal Profile

What You’ll Bring

• Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or a related field.
• 5–10 years of experience in data engineering, preferably within telecom, digital, or large‑scale enterprise environments.
• Hands‑on experience with large, complex datasets such as Call Detail Records (CDRs) or network logs.
• Advanced proficiency in SQL, NoSQL, and modern cloud data platforms (Snowflake, BigQuery, Databricks, Hadoop).
• Strong understanding of data governance, metadata management, and cataloging principles.
• Proven ability to work cross‑functionally and translate business needs into scalable data solutions.
• Certification in CDMP or related data management credentials is a plus.
• Excellent problem‑solving, communication, and stakeholder management skills.

What's on Offer?

• Leadership Role
• Excellent career development opportunities
• Work within a company with a solid track record of success