Senior Data Engineer - Platform

DFI Retail Group; Selangor; On-site; MYR 120,000 - 180,000; Full time

Job summary

DFI Retail Group in Malaysia seeks a Senior Data Engineer - Platform to enhance data operations and platform reliability. You will design, build, and maintain scalable CI/CD pipelines on GCP, automate repetitive tasks, and drive data ops workflows.

You will collaborate with IT and Cloud Infra teams, implement infrastructure as code with Terraform, and ensure observability through monitoring, logging, and on-call support as part of incident response and continuous improvement.

Qualifications

• Bachelor’s or master’s degree in Computer Science, Engineering, or related fields.
• 2+ years of experience as a Site Reliability Engineer, DevOps Engineer, or similar role.
• Proficiency in Python.
• Experience building CI/CD pipelines.
• Experience with Google Cloud Platform (GCP) or other cloud platforms (Azure, AWS).
• Experience with on-call, incident response, and post-mortems.

Responsibilities

• Troubleshoot and resolve data-related issues promptly to minimize downtime.
• Design, build, and maintain scalable CI/CD pipelines on the GCP system.
• Develop and maintain Data Ops Workflows, Processes and Automation; implement infrastructure as code using Terraform.
• Maintain observability of Data Engineering infrastructure, including monitoring, logging, alerts, and performance optimization.
• Collaborate with IT and Cloud Infra teams to implement best practices and provide training and support to stakeholders.

Skills

Python

CI/CD

Cloud experience

Education

Bachelor’s or Master’s in CS/Engineering

Tools

Terraform

Job description

Is this your next challenge as a Senior Data Engineer - Platform?

The challenge is to:

Data Operations:

• Troubleshoot and resolve data-related issues promptly to minimize downtime and ensure business continuity.
• Design, build, and maintain efficient and scalable CI/CD pipelines of the GCP system, automate repetitive tasks and processes to improve operational efficiency and reduce manual intervention.
• Develop and maintain Data Ops Workflows, Processes, and Ops Automation Systems. Collaborate with DFI IT and Cloud Infra teams to implement infrastructure as code using tools like Terraform or self-developed system.
• Maintain and manage the observability of infrastructure environment of Data Engineering, including monitoring, logging, alerting, notification and so on, focusing on the monitor system performance and proactively identify and resolve issues. Optimize system performance and resource utilization.

Collaboration and Communication:

• Work closely with cross-functional teams to understand business needs and deliver data-driven insights.
• Provide technical support, data ops environment on-call and training to team members and stakeholders on data operation tools and best practices.
• Stay updated with the latest trends and technologies in data engineering and operations, and recommend improvements as needed.

Do you have experience in?

• Bachelor’s or master’s degree in Computer Science, Engineering, or related fields.
• Proven 2+ years of experience as a Site Reliability Engineer, DevOps Engineer, or similar role.
• Proficiency in one of the programming languages such as Python.
• Experience in building CI/CD would be a huge plus.
• Experience with operating Google Cloud Platform (GCP) is a huge plus, however experience in other cloud platform is also welcomed (e.g., Azure, AWS).
• Experience in part of operation activities such as on-call, building operation handbook, be part of incidence response event, writing post-mortem document, etc.
• Strong problem-solving skills and attention to detail.
• Excellent communication and teamwork abilities.

If you have the right skills and experience, this is an opportunity to build your career with Asia’s leading retailer.

DFI Retail Group is an equal opportunity employer and responsible for ensuring that all personal information collected from each Candidate presented to DFI Retail Group is used for recruitment purposes only and the personaldata will be kept and handled confidentially. We will retain the applications of candidates not selected for a period of no more than 24 months. The data collection process is in accordance with all applicable laws and compliantwith the Code of Practice on Human Resource Management.

To find out more about Our Businesses and Our People, please visit our