Data Platform System Engineer

Singapore Power

Singapore

On-site

SGD 140,000 - 200,000

Full time

13 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Wellness programmes
Collaborative teams

Job summary

SP Group is seeking a seasoned Data Platform Engineer to operate and evolve its enterprise Data & AI platform, supporting mission-critical analytics, regulatory compliance, and AI-driven innovation across the business.

You will design, deploy, and manage large-scale Hadoop-based environments (Cloudera CDP, Hive, Spark), implement IaC with Terraform and Ansible, and partner with data engineers, scientists, and governance teams to ensure uptime, security, and performance.

Qualifications

  • 5-10 years of experience in data platform engineering, big data operations, or infrastructure engineering.
  • Strong hands-on experience managing big data platforms (Cloudera CDP, Hadoop ecosystem).
  • Deep understanding of Hadoop components: HDFS, Hive, Spark, HBase, and related services.
  • Experience with cluster operations, performance tuning, and troubleshooting.
  • Proficiency in automation and scripting (Python, Bash, Terraform, Ansible).
  • Experience with CI/CD pipelines and DevOps practices.
  • Solid understanding of data platform security and access control concepts.
  • Strong analytical and problem-solving skills with a proactive mindset.
  • Ability to work in a fast-paced, cross-functional environment.
  • Good communication skills with ability to translate technical topics to stakeholders.
  • Ownership mentality with focus on platform reliability and continuous improvement.

Responsibilities

  • Operate and evolve SP Group's enterprise data platform to support analytics, regulatory compliance, and AI-driven innovation.
  • Provide platform support and partnership to data engineering, analytics, and business teams.
  • Design, deploy, and manage large-scale data platform environments (Cloudera CDP, Hadoop ecosystem).
  • Manage cluster lifecycle including provisioning, scaling, patching, and upgrades.
  • Ensure uptime and reliability through proactive monitoring and maintenance.
  • Plan and coordinate upgrades, patching, and scaling activities; minimize service disruption.
  • Coordinate cross-team dependencies (infrastructure, network, security).
  • Document platform architecture, processes, and operational procedures.
  • Implement Infrastructure-as-Code using Terraform and Ansible.
  • Design and maintain CI/CD pipelines for platform configuration.
  • Automate provisioning, deployment, and operational workflows.
  • Improve observability through monitoring, alerting, and logging practices.
  • Implement security controls including Kerberos authentication, authorization (Ranger), and encryption.
  • Ensure compliance with data governance, security policies, and regulatory requirements.
  • Support auditability, access control, and data protection mechanisms.
  • Collaborate with data engineers, data scientists, and business teams to enable data solution delivery.
  • Partner with infrastructure, network, and security teams to ensure platform integration and stability.

Skills

Data platform engineering
DevOps automation
Regulatory compliance
Strong communication

Tools

Cloudera CDP
Hadoop ecosystem
Terraform
Ansible
Spark

Job description

You will be responsible for operating and evolving SP Group’s enterprise Data & AI platform to support mission-critical analytics, regulatory compliance, and AI-driven innovation. This role focuses on ensuring the platform is scalable, reliable, secure, and performant, while enabling data engineers, scientist and analysts to deliver business value efficiently.

What You'll Do
  • Ensure high availability and reliability of the enterprise data platform (Cloudera and Talend Big Data).
  • Deliver scalable and performant data infrastructure supporting batch and near real-time workloads.
  • Enable secure and compliant data operations aligned with enterprise and regulatory requirements.
  • Improve platform automation and operational efficiency through DevOps and Infrastructure-as-Code.
  • Provide strong platform support and partnership to data engineering, analytics, and business teams.
Data Platform Engineering & Operations
  • Design, deploy, and manage large-scale data platform environments (primarily Cloudera and Talend Big Data).
  • Operate and optimize Hadoop ecosystem components (HDFS, Hive, Spark, HBase, Impala, Iceberg, Ozone).
  • Manage cluster lifecycle including provisioning, scaling, patching, and upgrades.
  • Ensure platform uptime, stability, and service reliability through proactive monitoring and maintenance.
Performance, Scalability & Capacity Management
  • Monitor workload performance and optimize data processing efficiency.
  • Perform capacity planning to support increasing data volumes and usage.
  • Troubleshoot performance bottlenecks across compute, storage, and query layers.
Platform Delivery & Execution Planning
  • Plan and coordinate execution of platform upgrades, patching, and scaling activities.
  • Manage deployment schedules and ensure minimal service disruption.
  • Coordinate cross-team dependencies (infrastructure, network, security).
  • Track and report execution progress against platform roadmap.
DevOps, Automation & Platform Engineering
  • Implement Infrastructure-as-Code using tools such as Terraform and Ansible.
  • Design and maintain CI/CD pipelines for platform configuration.
  • Automate platform provisioning, deployment, and operational workflows.
  • Improve observability through monitoring, alerting, and logging practices.
Security, Governance & Compliance
  • Implement and manage platform security controls including authentication (Kerberos), authorization (e.g. Ranger), and encryption.
  • Ensure compliance with enterprise data governance, security policies, and regulatory requirements.
  • Support auditability, access control, and data protection mechanisms.
Collaboration & Platform Enablement
  • Work closely with data engineers, data scientists, and business teams to enable data solution delivery.
  • Partner with infrastructure, network, and security teams to ensure platform integration and stability.
  • Provide guidance, troubleshooting, and best practices to users of the platform.
  • Document platform architecture, processes, and operational procedures.
What You’ll Need
  • 5- 10 years of experience in data platform engineering, big data operations, or infrastructure engineering.
  • Strong hands-on experience managing big data platforms (Cloudera CDP, Hadoop ecosystem).
  • Deep understanding of Hadoop components: HDFS, Hive, Spark, HBase, and related services.
  • Experience with cluster operations, performance tuning, and troubleshooting.
  • Proficiency in automation and scripting (Python, Bash, Terraform, Ansible).
  • Experience with CI/CD pipelines and DevOps practices.
  • Solid understanding of data platform security and access control concepts.
  • Strong analytical and problem-solving skills with a proactive mindset.
  • Ability to work in a fast-paced, cross-functional environment.
  • Good communication skills with ability to translate technical topics to stakeholders.
  • Ownership mentality with focus on platform reliability and continuous improvement.
Good to have
  • Experience with Databricks, Talend, or hybrid data platforms.
  • Knowledge of containerization and orchestration.
  • Experience with streaming platforms (e.g. Kafka) or real-time processing.
  • Familiarity with modern data lake-house concepts (e.g. Iceberg, Delta).
  • Exposure to cloud or hybrid environments (Azure preferred).
What We’ll Provide
  • Join us to empower the future of energy.
  • You will work in teams that thrive on collaboration for outstanding achievements.
  • We have regular wellness programmes to promote healthy living
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Platform System Engineer
Data Platform System Engineer

SINGAPORE POWER LIMITED • Singapore

On-site
SGD 120,000 - 170,000
Wellness programmes
Big Data Platform Engineer
Big Data Platform Engineer

Kerry Consulting Pte Ltd • Singapore

On-site
SGD 120,000 - 180,000
Data Engineer - Data Lake
Data Engineer - Data Lake

Unison Group • Singapore

On-site
SGD 90,000 - 130,000
Applications Developer
Applications Developer

REGTECH INSIGHT PTE. LTD. • Singapore

On-site
SGD 120,000 - 180,000
Applications Developer
Applications Developer

RISKDATA CONSULTING PTE. LTD. • Singapore

On-site
SGD 120,000 - 180,000
Applications Developer
Applications Developer

UNISYNC SYSTEMS PTE. LTD. • Singapore

On-site
SGD 90,000 - 130,000
Applications Developer
Applications Developer

UNISONEDGE CONSULTING PTE. LTD. • Singapore

On-site
SGD 90,000 - 130,000
APPLICATIONS DEVELOPER
APPLICATIONS DEVELOPER

Riskdata Consulting • Singapore

On-site
SGD 120,000 - 180,000
Senior Data Platform Engineer — Scale, Security & AI Ops
Senior Data Platform Engineer — Scale, Security & AI Ops

Singapore Power • Singapore

On-site
SGD 140,000 - 200,000
Wellness programmes
Collaborative teams
Solution Architect
Solution Architect

Riskdata Consulting • Singapore

On-site
SGD 120,000 - 180,000