Senior Data Engineering Leader: Scale & Innovate Platform

DFI Retail Group; Petaling Jaya; On-site; MYR 320,000 - 520,000; Full time

Job summary

DFI Retail Group is seeking a Data Engineering Senior Manager to design, build, and scale a modern data platform powering analytics, AI, and BI. You will lead a team delivering secure, scalable data ecosystems with high availability and reliable processing across the organization.

You will collaborate with data engineers, analysts, and business teams to enable seamless data access and insights, define technical strategy for data infrastructure, and mentor a high-performing team while driving

Qualifications

• 8+ years of experience in data engineering or platform engineering, with leadership experience.
• Hands-on experience with cloud platform technologies (GCP preferred, AWS or Azure welcomed).
• Hands-on experience with cloud data warehouses (BigQuery, Snowflake, Redshift, Synapse).
• Deep experience with data platform design patterns and architecture.
• Experience with orchestration tools (Airflow, Prefect, Dagster) and tuning performance.
• Proficiency in Python or Java; SQL and scripting (bash).
• Experience with CI/CD pipelines and containerization (Docker, Kubernetes).
• Strong data governance, security, and cost optimization.
• Excellent written and spoken English communication.

Responsibilities

• Lead the design, implementation, and maintenance of a scalable data platform.
• Define and execute the technical strategy for data infrastructure, storage, and processing.
• Build and optimize data ingestion, transformation, storage, and orchestration frameworks.
• Own data platform architecture, development, maintenance, and operations.
• Establish best practices for data governance, security, and compliance.
• Evaluate and integrate emerging data technologies to enhance platform capabilities.
• Govern choice of tools, processes, and practices for handling data.
• Build internal tooling to empower data platform users.
• Champion platform mindset and improve productivity via scalable tooling.
• Be SME enabling other teams to use data technologies.
• Mentor and develop a high-performing data engineering team.

Skills

Leadership

Mentorship

Stakeholder comms

English proficiency

Independent worker

Education

Bachelor's degree in technology/Engineering or related field

Tools

Airflow

Prefect

Dagster

Jenkins

GitHub Actions

Bitbucket Pipeline

Docker

Kubernetes

Terraform

GCP

AWS

Azure

BigQuery

Snowflake

Redshift

Kafka

Flink

Pulsar

Kinesis

SQL

NoSQL

Job description

DFI Retail Group is seeking a Data Engineering Senior Manager to design, build, and scale a modern data platform powering analytics, AI, and BI. You will lead a team delivering secure, scalable data ecosystems with high availability and reliable processing across the organization.

You will collaborate with data engineers, analysts, and business teams to enable seamless data access and insights, define technical strategy for data infrastructure, and mentor a high-performing team while driving