Data Engineering Senior Manager

DFI Retail Group; Selangor; On-site; MYR 180,000 - 240,000; Full time

Job summary

DFI Retail Group in Malaysia seeks a Data Engineering, Senior Manager to design, build, and scale a modern data platform powering analytics, AI, and business intelligence. You will lead a team to develop a robust, secure, and scalable data ecosystem with high availability and reliable processing.

You will collaborate with data engineers, analysts, and business teams to enable seamless data access and insights across the organization, driving platform excellence in Pan Asia’s leading retailer.

Qualifications

• Bachelor’s degree in technology, engineering, or related field.
• 8+ years in data engineering/platform engineering with leadership experience.
• Hands-on experience with cloud platforms (GCP preferred; AWS/Azure welcomed).
• Experience with cloud data warehouses (BigQuery, Snowflake, Redshift, Synapse).
• Deep experience with orchestration tools (Airflow, Prefect, Dagster).
• Understanding of data platform design patterns and architecture.
• Experience building large-scale data platforms with high throughput and low latency.
• Strong knowledge of data governance, security, and cost optimization.
• Proficient in Python/Java and SQL; familiar with CI/CD and IaC.
• Excellent communication in English.

Responsibilities

• Lead design, implementation, and maintenance of a scalable data platform.
• Define technical strategy for data infrastructure, storage, and processing.
• Build and optimize data ingestion, transformation, storage, and orchestration.
• Oversee data platform architecture, development, maintenance, and operations.
• Establish best practices for governance, security, and compliance.
• Evaluate emerging data technologies to enhance capabilities.
• Guide tool choices and data handling practices across teams.
• Develop internal tooling to improve platform productivity.
• Mentor a high-performing team of data engineers.

Skills

Python/Java programming

SQL & scripting

CI/CD pipelines

Data governance & security

Cloud platforms (GCP/AWS/Azure)

Leadership & mentoring

Data platform design & architecture

English communication

Education

Bachelor’s degree in technology/engineering or related field

Tools

Airflow

Prefect

Dagster

BigQuery

Snowflake

Redshift

Synapse

Docker

Kubernetes

Terraform

Jenkins

GitHub Actions

Kafka

Flink

Kinesis

Pulsar

Job description

Jora Malaysia will close on 9th September 2026. Thank you for being with us, we are cheering you on as you continue your career journey.

We are seeking a Data Engineering, Senior Manager to design, build, and scale a modern data platform that powers analytics, AI, and business intelligence. In this role, you will lead a team responsible for developing a robust, secure, and scalable data ecosystem, ensuring high availability, reliability, and efficiency of data processing. You will collaborate with data engineers, analysts, and business teams to enable seamless data access and insights across the organization.

Is this your next challenge as a Data Engineering, Senior Manager?

The challenge is to:

• Lead the design, implementation, and maintenance of a scalable data platform.
• Define and execute the technical strategy for data infrastructure, storage, and processing.
• Build and optimize data ingestion, transformation, storage, and orchestration frameworks.
• In charge of overall data platform architecture design, development, maintenance, and operation.
• Establish best practices for data governance, security, and compliance.
• Evaluate and integrate emerging data technologies to enhance platform capabilities.
• Govern choice of tools, process, and practices of handling data within data platform.
• Build internal tooling to enhance working within data platforms, used by data platform users.
• Champion platform mindset, be the force multiplier to enhance everyone’s productivity by providing scalable data platform and common tooling.
• Be subject matter expert for enabling other team to use data technologies.
• Mentor and develop a high-performing team of data engineers.

Do you have experience in Scaling data team?

• Bachelor’s degree in technology, Engineering, or a related field.
• 8+ years of experience in data engineering or platform engineering, plus for holding leadership experience in a high-growth, fast-paced environment.
• Hands-on experience with cloud platform technologies (GCP preferred, AWS or Azure are also welcomed).
• Hands-on experience with cloud data warehouses (BigQuery, Snowflake, Redshift, Synapse).
• Deep experience with orchestration tools (Airflow, Prefect, Dagster) and know to fine-tune.
• Deep understanding of data platform design pattern and architecture.
• Experience in designing and building large scale data platform with high throughout and low latency, as well as operation and fine-tuning performance.
• Deep understanding of various data technologies, their trade-off, and what technologies to choose based on needs.
• Experience in building fit-for-purpose data solutions.
• Experience optimizing cloud cost and performance for large-scale data platforms.
• Knowledge of real-time data streaming and messaging systems (Flink, Kafka, Kinesis, Pulsar).
• Experience in working with both SQL and NoSQL databases.
• Experience in implementing data systems observability and alerting.
• Proficient in programming languages like Python or Java.
• Proficient in SQL and scripting languages (bash, etc).
• Strong understanding of data governance, security, and compliance best practices.
• Experience in building CI/CD pipelines or platform using tools such as Jenkins, GitHub Actions, Bitbucket Pipeline, etc.
• Experience in containerization technology (Docker, Kubernetes, etc)
• Experience in driving Infrastructure as a Code project using tools such as Terraform.
• Able to work independently in a fast-paced environment with minimum supervision.
• Good communication skills including strong written and spoken English.

Nice to have:

• Exposure to ML/AI related projects, process, and tooling
• Experience in building end-to-end ML-platform
• Experience with data mesh and distributed data architectures.
• Understanding of GraphQL and API-based data access layers.

If you have the right skills and experience, this is an opportunity to build your career with Pan Asia’s leading retailer.

DFI Retail Group is an equal opportunity employer and responsible for ensuring that all personal information collected from each Candidate presented to DFI Retail Group is used for recruitment purposes only and the personal data will be kept and handled confidentially. We will retain the applications of candidates not selected for a period of no more than 24 months. The data collection process is in accordance with all applicable laws and compliant with the Code of Practice on Human Resource Management.

To find out more about Our Businesses and Our People, please visit our website: https://www.DFIretailgroup.com