Senior Platform Engineer

PEOPLESEARCH PTE. LTD.; Singapore; On-site; SGD 120,000 - 160,000; Full time

Job summary

PeopleSearch Pte Ltd is seeking an experienced Platform Engineer to operate and evolve an enterprise Data & AI Platform, with a strong focus on Cloudera and Hadoop, infrastructure automation, and reliability. This is a hands-on role ensuring the environment is scalable, secure, highly available, and performant.

The role covers cluster provisioning, tuning, monitoring, incident response, CI/CD for deployment, and security management to maintain platform health and capacity at scale.

Qualifications

• 5-10 years of experience in platform engineering, infrastructure engineering, Big Data operations, or similar roles.
• Strong hands-on Cloudera CDP administration and operations experience.
• Strong knowledge of the Hadoop ecosystem and distributed platforms.
• Experience with cluster operations, performance tuning, troubleshooting, patching, and upgrades.
• Hands-on experience with Terraform and/or Ansible and infrastructure automation.
• Strong scripting skills in Python and/or Bash.
• Experience with on-prem infrastructure is highly preferred.
• Understanding of Kerberos, Ranger, encryption, authentication, and access control.
• Experience with monitoring, incident management, and root-cause analysis.
• Strong problem-solving and communication skills.

Responsibilities

• Administer and operate Cloudera CDP and Hadoop platforms in enterprise environments.
• Manage Hadoop components including HDFS, Hive, Spark, HBase, Impala, Iceberg, and Ozone.
• Perform cluster provisioning, configuration, scaling, patching, upgrades, and lifecycle management.
• Monitor platform health, availability, performance, and capacity.
• Troubleshoot infrastructure, cluster, storage, compute, and platform issues.
• Implement automation and Infrastructure-as-Code using Terraform, Ansible, Python, and Bash.
• Maintain CI/CD processes for platform configuration and infrastructure deployment.
• Implement monitoring, alerting, logging, and operational processes.
• Manage platform security including Kerberos, Ranger, encryption, and access controls.
• Coordinate platform changes and maintenance with infrastructure, network, and security teams.
• Maintain operational documentation, runbooks, and platform standards.
• Provide technical support for Cloudera and Hadoop environments.

Skills

Cloudera CDP administration

Hadoop ecosystem

Terraform

Ansible

Python

Bash

CI/CD

Monitoring

Security

On-prem infrastructure

Tools

Terraform

Ansible

Job description

About the Job

You will be responsible for operating and evolving an enterprise Data & AI Platform, with a strong focus on Cloudera, Hadoop platform operations, infrastructure automation, and reliability . This isa hands-on platform/infrastructure role focused on ensuring the environment is scalable, secure, highly available, and performant. Strong Cloudera experience is a must.

What You'll Do

• Administer and operate Cloudera CDP and Hadoop platforms in enterprise environments.
• Manage Hadoop components including HDFS, Hive, Spark, HBase, Impala, Iceberg, and Ozone .
• Perform cluster provisioning, configuration, scaling, patching, upgrades, and lifecycle management.
• Monitor platform health, availability, performance, and capacity.
• Troubleshoot infrastructure, cluster, storage, compute, and platform issues.
• Implement automation and Infrastructure-as-Code using Terraform, Ansible, Python, and Bash .
• Maintain CI/CD processes for platform configuration and infrastructure deployment.
• Implement monitoring, alerting, logging, and operational processes.
• Manage platform security including Kerberos, Ranger, encryption, and access controls .
• Coordinate platform changes and maintenance with infrastructure, network, and security teams.
• Maintain operational documentation, runbooks, and platform standards.
• Provide technical support for Cloudera and Hadoop environments.

What You'll Need

• At least 5 - 10 years of experience in platform engineering, infrastructure engineering, Big Data operations, or similar roles.
• Strong hands-on Cloudera CDP administration and operations experience.
• Strong knowledge of the Hadoop ecosystem and distributed platforms.
• Experience with cluster operations, performance tuning, troubleshooting, patching, and upgrades.
• Hands-on experience with Terraform and/or Ansible and infrastructure automation.
• Strong scripting skills in Python and/or Bash .
• Experience with on-prem infrastructure is highly preferred.
• Understanding of Kerberos, Ranger, encryption, authentication, and access control .
• Experience with monitoring, incident management, and root-cause analysis.
• Strong problem-solving and communication skills.

All information will be kept strictly confidential. We regret to inform that only successful applicants will be contacted.

PeopleSearch Pte Ltd

EA License No. 16S8057