Cloudera Data Platform Engineer | Big Data Automation & Ops

Tech Aalto Pte. Ltd; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

Tech Aalto Pte. Ltd is seeking a Cloudera Data Platform Engineer to join our team in Singapore. The ideal candidate will have hands-on experience with Cloudera Data Platform components such as HDFS, YARN, HIVE, Spark, Impala and Ranger, along with strong knowledge of operating systems, security, and networking.

You will be responsible for monitoring, troubleshooting, and optimizing big data environments using advanced tools and automation to ensure high availability and reliability.

Qualifications

• Hands-on experience with at least three Cloudera Data Platform components.
• Proficiency with monitoring tools such as Cloudera Manager, Zabbix, Grafana, Splunk, SyslogNG.
• Scripting skills in bash, Python, or shell scripting for automation.
• Familiarity with middleware like Informatica and Denodo is a plus.

Responsibilities

• Cloudera Data Platform Management: manage and troubleshoot CP components (HDFS, YARN, HIVE, Spark, Impala, Ranger).
• Ensure data security and integrity within the platform.
• Optimize performance and resource usage across the data ecosystem.
• Monitoring and Troubleshooting: use monitoring tools for proactive incident management.
• Automation: develop automation scripts to streamline provisioning, monitoring, and maintenance.
• Middleware and Integration: collaborate with Informatica and Denodo for data integration.
• Cloud Exposure: work with AWS/Azure for data storage and processing when applicable.

Skills

Cloudera Data Platform

HDFS

YARN

HIVE

Spark

Impala

Ranger

Automation scripting

Python

Bash

Cloud (AWS/Azure)

Tools

Cloudera Manager

Zabbix

Grafana

Splunk

SyslogNG

Informatica

Denodo

AWS

Azure

Job description

Tech Aalto Pte. Ltd is seeking a Cloudera Data Platform Engineer to join our team in Singapore. The ideal candidate will have hands-on experience with Cloudera Data Platform components such as HDFS, YARN, HIVE, Spark, Impala and Ranger, along with strong knowledge of operating systems, security, and networking.

You will be responsible for monitoring, troubleshooting, and optimizing big data environments using advanced tools and automation to ensure high availability and reliability.