Hadoop Administration

Sonata Software; Chennai District; On-site; INR 900,000 - 1,400,000; Full time

Job summary

Sonata Software in Chennai is hiring an experienced Hadoop Administrator to design, implement, and manage enterprise Big Data platforms. You will work with Cloudera CDP, Cloudera Manager, HDFS, YARN, Hive, Spark, Impala, ZooKeeper, JournalNodes, Kerberos, and Apache Ranger, delivering production support and high availability.

The role covers performance tuning, capacity planning, upgrades, patching, incident management, and 24x7 support, with a focus on security and disaster recovery.

Qualifications

• Experienced Hadoop Administrator with 8+ years of expertise in designing, implementing, administering, monitoring, troubleshooting, and supporting enterprise Big Data platforms.
• Strong hands-on experience with Cloudera CDP, Cloudera Manager, HDFS, YARN, Hive, Spark, Impala, ZooKeeper, JournalNodes, Kerberos, and Apache Ranger.

Responsibilities

• Administer and support Cloudera CDP Hadoop clusters using Cloudera Manager.
• Manage HDFS, YARN, Hive, Spark, Impala, ZooKeeper, and JournalNodes.
• Configure and troubleshoot HDFS HA, NameNode, DataNode, and JournalNode quorum issues.
• Manage YARN resources, queues, applications, and capacity planning.
• Perform DataNode decommission/recommission, node addition/removal, and cluster expansion.
• Configure and troubleshoot Kerberos authentication and Apache Ranger authorization.
• Monitor cluster health, capacity, performance, and service availability.
• Perform Hadoop service restarts, rolling restarts, patching, upgrades, and maintenance.
• Troubleshoot HDFS, YARN, Hive, Spark, Impala, and Kerberos production issues.
• Perform Spark-on-YARN performance and resource tuning.
• Analyze Hadoop application/service logs and perform RCA for production incidents.
• Manage HDFS replication, snapshots, quotas, balancing, and storage utilization.
• Support backup, disaster recovery, HA/failover, and recovery activities.
• Integrate Hadoop/Spark logs with Splunk and enterprise monitoring tools.
• Provide 24x7 production support, incident management, and change management.
• Prepare SOPs, RCA documents, operational reports, and technical documentation.

Skills

Hadoop Administration

Cloudera CDP

HDFS

YARN

Hive

Spark

Impala

ZooKeeper

Kerberos

Apache Ranger

RHEL/Linux

Splunk

ServiceNow/JIRA

Tools

Cloudera Manager

Cloudera CDP

Job description

We are hiring for an exciting opportunity for the position of Hadoop Admin istration

Job Title: Hadoop Administration

Experience - 8+yrs

Notice Period- 15 to immediate

Professional Summary

Experienced Hadoop Administrator with 8+ years of expertise in designing, implementing, administering, monitoring, troubleshooting, and supporting enterprise Big Data platforms. Strong hands‑on experience with Cloudera CDP, Cloudera Manager, HDFS, YARN, Hive, Spark, Impala, ZooKeeper, JournalNodes, Kerberos, and Apache Ranger. Experienced in production support, high availability, disaster recovery, performance tuning, security, capacity management, upgrades, patching, and incident management.

Key Responsibilities

- Administer and support Cloudera CDP Hadoop clusters using Cloudera Manager.

- Manage HDFS, YARN, Hive, Spark, Impala, ZooKeeper, and JournalNodes.

- Configure and troubleshoot HDFS HA, NameNode, DataNode, and JournalNode quorum issues.

- Manage YARN resources, queues, applications, and capacity planning.

- Perform DataNode decommission/recommission, node addition/removal, and cluster expansion.

- Configure and troubleshoot Kerberos authentication and Apache Ranger authorization.

- Monitor cluster health, capacity, performance, and service availability.

- Perform Hadoop service restarts, rolling restarts, patching, upgrades, and maintenance.

- Troubleshoot HDFS, YARN, Hive, Spark, Impala, and Kerberos production issues.

- Perform Spark-on-YARN performance and resource tuning.

- Analyze Hadoop application/service logs and perform RCA for production incidents.

- Manage HDFS replication, snapshots, quotas, balancing, and storage utilization.

- Support backup, disaster recovery, HA/failover, and recovery activities.

- Integrate Hadoop/Spark logs with Splunk and enterprise monitoring tools.

- Provide 24x7 production support, incident management, and change management.

- Prepare SOPs, RCA documents, operational reports, and technical documentation.

Technical Skills

HDFS, YARN, Hive, Spark, Impala, Oozie, ZooKeeper, Cloudera CDP, Cloudera Manager, Kerberos, Apache Ranger, RHEL/Linux, ServiceNow/JIRA, Splunk.