Data Engineering Senior Manager

DFI Retail Group; Petaling Jaya; On-site; MYR 320,000 - 520,000; Full time

Job summary

DFI Retail Group is seeking a Data Engineering Senior Manager to design, build, and scale a modern data platform powering analytics, AI, and BI. You will lead a team delivering secure, scalable data ecosystems with high availability and reliable processing across the organization.

You will collaborate with data engineers, analysts, and business teams to enable seamless data access and insights, define technical strategy for data infrastructure, and mentor a high-performing team while driving

Qualifications

• 8+ years of experience in data engineering or platform engineering, with leadership experience.
• Hands-on experience with cloud platform technologies (GCP preferred, AWS or Azure welcomed).
• Hands-on experience with cloud data warehouses (BigQuery, Snowflake, Redshift, Synapse).
• Deep experience with data platform design patterns and architecture.
• Experience with orchestration tools (Airflow, Prefect, Dagster) and tuning performance.
• Proficiency in Python or Java; SQL and scripting (bash).
• Experience with CI/CD pipelines and containerization (Docker, Kubernetes).
• Strong data governance, security, and cost optimization.
• Excellent written and spoken English communication.

Responsibilities

• Lead the design, implementation, and maintenance of a scalable data platform.
• Define and execute the technical strategy for data infrastructure, storage, and processing.
• Build and optimize data ingestion, transformation, storage, and orchestration frameworks.
• Own data platform architecture, development, maintenance, and operations.
• Establish best practices for data governance, security, and compliance.
• Evaluate and integrate emerging data technologies to enhance platform capabilities.
• Govern choice of tools, processes, and practices for handling data.
• Build internal tooling to empower data platform users.
• Champion platform mindset and improve productivity via scalable tooling.
• Be SME enabling other teams to use data technologies.
• Mentor and develop a high-performing data engineering team.

Skills

Leadership

Mentorship

Stakeholder comms

English proficiency

Independent worker

Education

Bachelor's degree in technology/Engineering or related field

Tools

Airflow

Prefect

Dagster

Jenkins

GitHub Actions

Bitbucket Pipeline

Docker

Kubernetes

Terraform

GCP

AWS

Azure

BigQuery

Snowflake

Redshift

Kafka

Flink

Pulsar

Kinesis

SQL

NoSQL

Job description

We are seeking a Data Engineering, Senior Manager to design, build, and scale a modern data platform that powers analytics, AI, and business intelligence. In this role, you will lead a team responsible for developing a robust, secure, and scalable data ecosystem, ensuring high availability, reliability, and efficiency of data processing. You will collaborate with data engineers, analysts, and business teams to enable seamless data access and insights across the organization.

Is this your next challenge as a Data Engineering, Senior Manager?

The challenge is to:

• Lead the design, implementation, and maintenance of a scalable data platform.
• Define and execute the technical strategy for data infrastructure, storage, and processing.
• Build and optimize data ingestion, transformation, storage, and orchestration frameworks.
• In charge of overall data platform architecture design, development, maintenance, and operation.
• Establish best practices for data governance, security, and compliance.
• Evaluate and integrate emerging data technologies to enhance platform capabilities.
• Govern choice of tools, process, and practices of handling data within data platform.
• Build internal tooling to enhance working within data platforms, used by data platform users.
• Champion platform mindset, be the force multiplier to enhance everyone’s productivity by providing scalable data platform and common tooling.
• Be subject matter expert for enabling other team to use data technologies.
• Mentor and develop a high-performing team of data engineers.

Do you have experience in Scaling data team?

• Bachelor’s degree in technology, Engineering, or a related field.
• 8+ years of experience in data engineering or platform engineering, plus for holding leadership experience in a high-growth, fast-paced environment.
• Hands‑on experience with cloud platform technologies (GCP preferred, AWS or Azure are also welcomed).
• Hands‑on experience with cloud data warehouses (BigQuery, Snowflake, Redshift, Synapse).
• Deep experience with orchestration tools (Airflow, Prefect, Dagster) and know to fine‑tune.
• Deep understanding of data platform design pattern and architecture.
• Experience in designing and building large scale data platform with high throughout and low latency, as well as operation and fine‑tuning performance.
• Deep understanding of various data technologies, their trade‑off, and what technologies to choose based on needs.
• Experience in building fit‑for‑purpose data solutions.
• Experience optimizing cloud cost and performance for large-scale data platforms.
• Knowledge of real‑time data streaming and messaging systems (Flink, Kafka, Kinesis, Pulsar).
• Experience in working with both SQL and NoSQL databases.
• Experience in implementing data systems observability and alerting.
• Proficient in programming languages like Python or Java.
• Proficient in SQL and scripting languages (bash, etc).
• Strong understanding of data governance, security, and compliance best practices.
• Experience in building CI/CD pipelines or platform using tools such as Jenkins, GitHub Actions, Bitbucket Pipeline, etc.
• Experience in containerization technology (Docker, Kubernetes, etc)
• Experience in driving Infrastructure as a Code project using tools such as Terraform.
• Able to work independently in a fast‑paced environment with minimum supervision.
• Good communication skills including strong written and spoken English.

Nice to have:

• Exposure to ML/AI related projects, process, and tooling
• Experience in building end‑to‑end ML-platform
• Experience with data mesh and distributed data architectures.
• Understanding of GraphQL and API‑based data access layers.

If you have the right skills and experience, this is an opportunity to build your career with Pan Asia’s leading retailer.

DFI Retail Group is an equal opportunity employer and responsible for ensuring that all personal information collected from each Candidate presented to DFI Retail Group is used for recruitment purposes only and the personal data will be kept and handled confidentially. We will retain the applications of candidates not selected for a period of no more than 24 months. The data collection process is in accordance with all applicable laws and compliant with the Code of Practice on Human Resource Management.

To find out more about Our Businesses and Our People, please visit our website: https://www.DFIretailgroup.com