Cloudera Hadoop Admin

ness; Bengaluru; On-site; INR 1,500,000 - 2,300,000; Full time

Job summary

Ness in Bengaluru is seeking an experienced Cloudera Hadoop Admin to oversee large-scale Hadoop environments, focusing on installation, configuration, monitoring, and security. You will coordinate with support teams and drive operational excellence.

The role requires 5+ years in Hadoop administration, strong Linux/Unix skills, and hands-on experience with Cloudera stack (CDH/CDP). Expect production deployments, on-call coordination, and continuous improvement efforts.

Qualifications

• 5+ years of Hadoop Administration in enterprise environments.
• Strong hands-on experience with Hadoop, HDFS, YARN, Hive, Spark, Kafka, ZooKeeper, and Oozie.
• Expertise in Linux/Unix administration, shell scripting, and system troubleshooting.
• Experience with Hadoop cluster installation, configuration, monitoring, performance tuning, and capacity planning.
• Knowledge of Hadoop security including Kerberos, Ranger, LDAP/Active Directory integration.
• Experience with backup and recovery, high availability, and disaster recovery processes.
• Familiarity with monitoring tools such as Ambari, Cloudera Manager, Grafana, Splunk, or equivalent.
• Strong analytical, troubleshooting, and problem-solving skills.
• Excellent communication and stakeholder management skills.

Responsibilities

• Monitoring and administration of the Cloudera platform.
• Install and deploy the Hadoop cluster, add/remove nodes.
• Configure name-node, take backups, patch installations, etc.
• Monitor tasks and all critical parts of the cluster.
• Maintenance and operational activities.
• Maintenance of file system/log files.
• Manage OS patching and cluster parcel updates.
• Disaster recovery: backup plan for data loss.
• Continual improvement: performance optimization and automation.
• Code deployments in production environment.

Skills

Hadoop Administration

Linux/Unix administration

Shell scripting

Vendor coordination

Tools

Ambari

Cloudera Manager

Grafana

Splunk

Job description

Cloudera Hadoop Admin JD:

• 5+ years in Hadoop administration
• Strong experience in administration of large & complex Cloudera Hadoop environments
• Certification in Cloudera Hadoop administration
• Strong performance optimization skills with large Hadoop clusters
• Experience in On-call support (after hours), coordination with L1 teams / remote support teams
• Experience in issue escalation and resolution working with vendor support (Cloudera)

Key activities include:

• Monitoring and Administration activities of theCloudera platform

• Install and deploy the Hadoop cluster, add andremove nodes
• Configure name-node, take backups, patch installations etc.

• Monitor tasks and all the critical parts of thecluster
• Maintenance and Operational activities
• Maintenance of file system/log files.
• Manage OS Patching, cluster parcels updates.

• Disaster recovery: Backup plan for accidental data deletion.
• Continual improvement: Performance optimization, automation andimprovements
• Code deployments in Production environment

Mandatory Skills

• 5+ years of Hadoop Administration experience in enterprise environments.
• Strong hands-on experience with Hadoop, HDFS, YARN, Hive, Spark, Kafka, ZooKeeper, and Oozie.
• Expertise in Linux/Unix administration, shell scripting, and system troubleshooting.
• Experience with Hadoop cluster installation, configuration, monitoring, performance tuning, and capacity planning.
• Knowledge of Hadoop security including Kerberos, Ranger, LDAP/Active Directory integration.
• Experience with backup and recovery, high availability, and disaster recovery processes.
• Familiarity with monitoring tools such as Ambari, Cloudera Manager, Grafana, Splunk, or equivalent.
• Strong analytical, troubleshooting, and problem-solving skills.
• Excellent communication and stakeholder management skills.

Preferred Skills

• Experience with Cloudera CDP, Hortonworks, or MapR.
• Exposure to cloud-based big data platforms such as Azure HDInsight, Azure Databricks, AWS EMR, or Google Dataproc.
• Python automation and Infrastructure-as-Code experience.
• Basic understanding of SQL and data warehousing concepts.