Cloudera Data Platform Engineer

Tech Aalto Pte. Ltd; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

Tech Aalto Pte. Ltd is seeking a Cloudera Data Platform Engineer to join our team in Singapore. The ideal candidate will have hands-on experience with Cloudera Data Platform components such as HDFS, YARN, HIVE, Spark, Impala and Ranger, along with strong knowledge of operating systems, security, and networking.

You will be responsible for monitoring, troubleshooting, and optimizing big data environments using advanced tools and automation to ensure high availability and reliability.

Qualifications

• Hands-on experience with at least three Cloudera Data Platform components.
• Proficiency with monitoring tools such as Cloudera Manager, Zabbix, Grafana, Splunk, SyslogNG.
• Scripting skills in bash, Python, or shell scripting for automation.
• Familiarity with middleware like Informatica and Denodo is a plus.

Responsibilities

• Cloudera Data Platform Management: manage and troubleshoot CP components (HDFS, YARN, HIVE, Spark, Impala, Ranger).
• Ensure data security and integrity within the platform.
• Optimize performance and resource usage across the data ecosystem.
• Monitoring and Troubleshooting: use monitoring tools for proactive incident management.
• Automation: develop automation scripts to streamline provisioning, monitoring, and maintenance.
• Middleware and Integration: collaborate with Informatica and Denodo for data integration.
• Cloud Exposure: work with AWS/Azure for data storage and processing when applicable.

Skills

Cloudera Data Platform

HDFS

YARN

HIVE

Spark

Impala

Ranger

Automation scripting

Python

Bash

Cloud (AWS/Azure)

Tools

Cloudera Manager

Zabbix

Grafana

Splunk

SyslogNG

Informatica

Denodo

AWS

Azure

Job description

We are looking for a skilledCloudera Data Platform Engineerto join our dynamic team. The ideal candidate will have hands‑on experience withCloudera Data Platform componentssuch asHDFS, YARN, HIVE, Spark, Impala, Ranger, along with strong knowledge ofoperating systems, security, and networking. You will be responsible for monitoring, troubleshooting, and optimizing big data environments using advanced tools and automation s.

Key Responsibilities:

• Cloudera Data Platform Management:Manage and troubleshoot components of theCloudera Data Platform, including at least three of the following:HDFS, YARN, HIVE, Spark, Impala, Ranger.
• Ensure the security and integrity of data within the platform.
• Optimize performance and resource utilization across the data ecosystem.
• Monitoring and Troubleshooting:Utilize monitoring tools such asCloudera Manager, Zabbix, Grafana, Splunk, and SyslogNGfor proactive system monitoring and incident management.
• Perform root cause analysis and implement corrective actions to ensure high availability and reliability of data systems.
• Automation and ing:Develop and maintain automation s usingbash, Python, or shell ingto streamline operational tasks.
• Implement automated solutions for system provisioning, monitoring, and maintenance.
• Middleware and Integration:Collaborate with middleware applications such asInformaticaandDenodoto ensure seamless data integration and processing.
• Ensure compatibility and integration with other enterprise systems.
• Cloud Technology Exposure (Optional):Work withcloud technologies (AWS, Azure)for data storage, processing, and migration (if applicable).
• Collaborate with cloud architects to optimize data solutions in hybrid cloud environments.

Requirements:

• Technical Skills:Hands‑on experience with at leastthree componentsof theCloudera Data Platform:HDFS, YARN, HIVE, Spark, Impala, Ranger.
• Proficiency withmonitoring toolslikeCloudera Manager, Zabbix, Grafana, Splunk, and SyslogNG.
• Strong skills in ing languagessuch asbash, Python, or shell ingfor automation and process optimization.
• Familiarity withmiddleware applicationslikeInformaticaandDenodo.
• Basic understanding ofoperating systems, security, and networkconfigurations.
• Experience: 5+in managing and troubleshooting Cloudera Data Platform environments.
• Experience inmonitoring and incident managementusing advanced monitoring tools.
• Knowledge ofcloud technologies (AWS, Azure)is a plus.
• Soft Skills:Strong problem‑solving and analytical skills.
• Excellent communication and collaboration skills, with the ability to work effectively in a cross‑functional team environment.
• Ability to manage multiple tasks and prioritize effectively in a fast‑paced environment.

Preferred Qualifications:

• Certification inCloudera Data Platformor related big data technologies.
• Experience withcloud technologies (AWS, Azure)for data storage and processing.
• Familiarity withbig data frameworksand ecosystems.