Data Platform Engineer (Cloudera)

TOG Indonesia; Jakarta Pusat; On-site; IDR 279,000,000 - 502,200,000; Full time

Job summary

TOG Indonesia is seeking an experienced Cloudera Hadoop administrator in Jakarta to manage Cloudera Data Platform and Cloudera Data Services, including Cloudera Manager, Hive, Spark, and related components. You will perform daily cluster monitoring, Linux OS tuning on Red Hat, security hardening, backups and data replication with Hive BDR, and support testing with stakeholders.

The ideal candidate has 3+ years with CDP/CDS, 2+ years Linux and Kubernetes, the ability to work independently or in a

Qualifications

• 3+ years with CDP/CDS and Cloudera platforms.
• 2+ years of Linux (RHEL) administration and SystemD.
• 2+ years of Kubernetes and containerization is a major plus.
• Willing to work in the banking industry.

Responsibilities

• Manage and deploy best practices for Cloudera Data Platform and Cloudera Data Services, incl. Cloudera Manager, Hive, Spark.
• Perform daily cluster monitoring, Linux OS tuning, security hardening, and backups/replication.
• Support testing activities with various stakeholders and provide tuning recommendations.

Skills

Cloudera Data Platform

Cloudera Data Services

Hadoop

Spark

Hive

YARN

Kubernetes

Linux

Red Hat Enterprise Linux

Oozie

Ranger

Zookeeper

Knox

Kafka

Hue

Tools

Cloudera Manager

Cloudera Data Platform

Cloudera Data Services

Hive

Spark

Impala

HBase

Kafka

Hue

Oozie

Ranger

Zookeeper

Knox

Kubernetes

Job description

• Manage and deploy best practice for Hadoop cluster using Cloudera Data Platform infrastructure (Cloudera Manager, Cloudera Management Service, HDFS, Hive, Impala, Hue, Oozie, Ranger Zookeeper, Knox, Kafka, Hbase, Spark, YARN, etc.)
• Manage and deploy best practice for Cloudera Data Services, including Cloudera Machine Learning (previously Cloudera Data Science Workbench).
• Perform daily monitoring for Cloudera Data Platform cluster node, OS parameters, and device alert.
• Perform OS tuning for Cloudera Data Platform on Linux platform including configuration and best practice setting.
• Review and perform security hardening for OS setting and Cloudera Data Platform.
• Backup, restore, and Data Replication of Cloudera Data Platform system with Hive BDR.
• Support testing activities (including DR drill) with various stakeholders i.e. application teams, external parties.
• Able to give advice and recommendation for query and job tuning, including Spark (Java, Scala, and Python PySpark), Impala, and Hive.
• Establish and maintain documentation and standardsWorks as part a team and provide the support when requirement

• 3+ years of experience with Cloudera Data Platform and Cloudera Data Services.
• 2+ years of experience with OS Linux, ie. Red Hat Enterprise Linux and SystemD.
• 2+ years of experience with Kubernetes and containerization are a major plus.
• Having a problem-solving attitude, work independently and as part of a team.
• Willing to work in banking industry.