Hadoop Administrator - GCP

Horizontal Integration; Bengaluru; Hybrid; INR 900,000 - 1,300,000; Full time

Job summary

Horizontal Integration in Bengaluru (Manyata) invites an experienced Hadoop administrator to join our hybrid team. You will manage the Hadoop ecosystem, configure multi-tenant production clusters, and ensure high availability in our enterprise environment.

You will test open-source technologies for PoCs, work with cloud data tools like Data Proc, GCS, Looker and Power BI, and collaborate with cross‑functional teams to reduce toil and improve incident response.

Qualifications

• 3+ years of hands-on managing Hadoop and ecosystem technologies.
• Proven expertise in testing opensource technologies for proof of concepts.
• Experience configuring production clusters for multi-tenant platforms.
• Experience with open-source data technologies like Hive, Trino(Presto), Spark, etc.
• Experience with cloud data technologies like Data Proc, GCS, GCP, Looker, Power BI.
• Good understanding of Unix/Linux based operating system. Proficient in Linux, command-line tools, and general system debugging.
• Perform knowledge-based recovery of incidents and events.
• Communicate with end-users through both verbal and written communication channels.
• Execute repeatable tasks that include maintenance, deployments, monitoring, etc.
• Engage and partner with other technology teams.
• 1-2 years' experience working in a service desk / operations center.
• Basic understanding of ITIL.
• Strong written and verbal communication skills.
• Strong fundamentals of infrastructure and / or application technologies in an enterprise environment.
• Excellent troubleshooting, problem solving, critical thinking, and communication skills.
• Collaborating with application teams for Hadoop updates, patches, version upgrades when required.
• Enhance post-incident processes and ensure artifacts such as post-incident summaries and root cause analysis documentation are completed to a consistent and high standard.
• Evaluate and make use of availability monitoring, workflow automation and communications tools to reduce toil on our teams.

Responsibilities

• Manage Hadoop ecosystem and multi-tenant production clusters.
• Test open-source technologies for proof of concepts.
• Coordinate with application teams for updates and patches.
• Ensure post-incident summaries and RCA docs are completed to a high standard.
• Lead incident recovery and enhance monitoring and automation.
• Collaborate with other technology teams to improve processes.

Skills

Hadoop ecosystem

Unix/Linux

Incident management

Open-source testing

Communication

Troubleshooting

Automation

Cloud data concepts

Tools

Hadoop

Hive

Spark

Trino/Presto

Data Proc

GCS

GCP

Looker

Power BI

Linux

CLI

Monitoring tools

Automation tools

Job description

• Experience: 5-10 Year's
• Location: Manyata, Bangalore
• Mode of work: Hybrid

• 3+ years of hands-on managing Hadoop and the ecosystem technologies
• Proven expertise in testing opensource technologies for proof of concepts
• Experience configuring production clusters for multi-tenant platforms
• Experience with open-source data technologies like Hive, Trino(Presto), Spark, etc.
• Experience with cloud data technologies like Data Proc, GCS, GCP, Looker, Power BI
• Good understanding of Unix/Linux based operating system. Proficient in Linux, command-line tools, and general system debugging
• Perform knowledge-based recovery of incidents and events
• Communicate with end-users through both verbal and written communication channels
• Execute repeatable tasks that include maintenance, deployments, monitoring, etc.
• Engage and partner with other technology teams
• 1-2 years' experience working in a service desk / operations center
• Basic understanding of ITIL
• Strong written and verbal communication skills
• Strong fundamentals of infrastructure and / or application technologies in an enterprise environment
• Excellent troubleshooting, problem solving, critical thinking, and communication skills
• Collaborating with application teams for Hadoop updates, patches, version upgrades when required
• Enhance post-incident processes and ensure artifacts such as post-incident summaries and root cause analysis documentation are completed to a consistent and high standard
• Evaluate and make use of availability monitoring, workflow automation and communications tools to reduce toil on our teams