Cloudera Data Platform Engineer (DataOps & Automation)

Tech Aalto Pte ltd; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

Tech Aalto Pte Ltd is seeking a Cloudera Data Platform Engineer to manage and troubleshoot Cloudera components in a Singapore-based environment. The role focuses on HDFS, YARN, HIVE, Spark, Impala, and Ranger, with emphasis on security and system optimization.

You will monitor with Cloudera Manager, Zabbix, Grafana, Splunk, and SyslogNG, and develop automation scripts in Bash and Python. Collaboration with Informatica and Denodo ensures smooth data integration and processing.

Qualifications

• Hands-on experience with at least three components of the Cloudera Data Platform: HDFS, YARN, HIVE, Spark, Impala, Ranger.
• Proficiency with monitoring tools like Cloudera Manager, Zabbix, Grafana, Splunk, and SyslogNG.
• Strong scripting skills such as Bash or Python for automation and process optimization.
• Familiarity with middleware applications like Informatica and Denodo.
• Basic understanding of operating systems, security, and networking configurations.
• Experience with cloud technologies (AWS, Azure) is a plus.

Responsibilities

• Manage and troubleshoot Cloudera Data Platform components (HDFS, YARN, HIVE, Spark, Impala, Ranger).
• Ensure data security and integrity and optimize performance across the data ecosystem.
• Develop and maintain automation scripts for provisioning, monitoring, and maintenance.
• Collaborate with middleware and integration tools (Informatica, Denodo) for data processing.

Skills

HDFS

YARN

HIVE

Spark

Impala

Ranger

Monitoring

Bash

Python

Security basics

Tools

Cloudera Manager

Zabbix

Grafana

Splunk

SyslogNG

Informatica

Denodo

AWS

Azure

Job description

Tech Aalto Pte Ltd is seeking a Cloudera Data Platform Engineer to manage and troubleshoot Cloudera components in a Singapore-based environment. The role focuses on HDFS, YARN, HIVE, Spark, Impala, and Ranger, with emphasis on security and system optimization.

You will monitor with Cloudera Manager, Zabbix, Grafana, Splunk, and SyslogNG, and develop automation scripts in Bash and Python. Collaboration with Informatica and Denodo ensures smooth data integration and processing.