Senior Data Platform Engineer – DevOps for Big Data & AI

SPGroup; Singapore; On-site; SGD 120,000 - 180,000; Full time

Benefits offered by this job

Wellness programmes

Job summary

SP Group is seeking an experienced Data Platform Engineer to operate and evolve our enterprise Data & AI platform, supporting analytics, regulatory compliance, and AI-driven innovation. The role focuses on scalability, reliability, security, and performance to enable data engineers, scientists, and analysts to deliver business value efficiently.

You will design, deploy, and manage large-scale data platform environments, optimize Hadoop ecosystem components, and ensure platform uptime with

Qualifications

• 5–10 years of experience in data platform engineering, big data operations, or infrastructure engineering.
• Strong hands-on experience managing big data platforms (Cloudera CDP, Hadoop ecosystem).
• Deep understanding of Hadoop components: HDFS, Hive, Spark, HBase, and related services.
• Proficiency in automation and scripting (Python, Bash, Terraform, Ansible).
• Experience with CI/CD pipelines and DevOps practices.
• Solid understanding of data platform security and access control concepts.
• Strong analytical and problem-solving skills with a proactive mindset.

Responsibilities

• Ensure high availability and reliability of the enterprise data platform (Cloudera and Talend Big Data).
• Deliver scalable and performant data infrastructure supporting batch and near real-time workloads.
• Enable secure and compliant data operations aligned with regulatory requirements.
• Improve platform automation and operational efficiency through DevOps and IaC.
• Provide platform support to data engineering, analytics, and business teams.
• Plan and coordinate platform upgrades, patching, and scaling activities.

Skills

Strong analytical skills

Communication skills

Ownership mentality

Cross-functional collaboration

Tools

Cloudera CDP

Hadoop ecosystem

HDFS

Hive

Spark

HBase

Iceberg

Ozone

Terraform

Ansible

CI/CD

Python

Bash

Job description

SP Group is seeking an experienced Data Platform Engineer to operate and evolve our enterprise Data & AI platform, supporting analytics, regulatory compliance, and AI-driven innovation. The role focuses on scalability, reliability, security, and performance to enable data engineers, scientists, and analysts to deliver business value efficiently.

You will design, deploy, and manage large-scale data platform environments, optimize Hadoop ecosystem components, and ensure platform uptime with