Hadoop Administrator

Hackajob; Hyderabad, Pune District, Bengaluru; Hybrid; INR 3,500,000 - 4,500,000; Full time

Job summary

Hackajob in Hyderabad, India is seeking a seasoned Hadoop administrator to install, configure, and maintain the Hadoop ecosystem including HDFS, YARN, Hive, HBase, Spark, and related components.

The role focuses on monitoring, upgrades, security, high availability, disaster recovery, automation, and collaboration with data engineers to keep data pipelines running smoothly. Strong incident management and thorough documentation are required.

Responsibilities

• Strong expertise in Install, configure, and maintain Hadoop ecosystem components (HDFS, YARN, Hive, HBase, Spark, Oozie, Zookeeper, etc.).
• Monitor cluster performance and capacity; troubleshoot and resolve issues proactively.
• Manage cluster upgrades, patching, and security updates with minimal downtime.
• Implement and maintain data security, authorization, and authentication (Kerberos, Ranger, or Sentry).
• Configure and manage Hadoop high availability, disaster recovery, and backup strategies.
• Automate cluster monitoring, alerting, and performance tuning.
• Work closely with data engineering teams to ensure smooth data pipeline operations.
• Perform root cause analysis for recurring system issues and implement permanent fixes.
• Develop and maintain system documentation, including runbooks and SOPs.
• Support integration with third-party tools (Sqoop, Flume, Kafka, Airflow, etc.).
• Participate in on-call rotation and incident management for production support.

Skills

Hadoop ecosystem

Cluster management

Performance tuning

Incident management

Tools

HDFS

YARN

Hive

HBase

Spark

Oozie

Zookeeper

Sqoop

Flume

Kafka

Airflow

Job description

Job Description

Strong expertise in Install, configure, and maintain Hadoop ecosystem components (HDFS, YARN, Hive, HBase, Spark, Oozie, Zookeeper, etc.).

Monitor cluster performance and capacity; troubleshoot and resolve issues proactively.

Manage cluster upgrades, patching, and security updates with minimal downtime.

Implement and maintain data security, authorization, and authentication (Kerberos, Ranger, or Sentry).

Configure and manage Hadoop high availability, disaster recovery, and backup strategies.

Automate cluster monitoring, alerting, and performance tuning.

Work closely with data engineering teams to ensure smooth data pipeline operations.

Perform root cause analysis for recurring system issues and implement permanent fixes.

Develop and maintain system documentation, including runbooks and SOPs.

Support integration with third-party tools (Sqoop, Flume, Kafka, Airflow, etc.).

Participate in on-call rotation and incident management for production support.