Senior Hadoop Administrator (CDP)

Clover Infotech; Bengaluru; On-site; INR 1,500,000 - 2,600,000; Full time

Job summary

Clover Infotech in Bengaluru is seeking a hands-on Hadoop/Cloudera expert to manage production CDP environments and optimize Spark workloads. You will automate pipelines, enhance observability, and coordinate with data engineers on large-scale data projects.

The ideal candidate brings 8+ years of tech experience, strong scripting skills, and proven success in high-availability enterprise settings. Bengaluru-based role with global impact.

Qualifications

• Minimum 4 years of production Hadoop experience.
• 8+ years hands-on technology experience.
• Experience with large, high-availability enterprises.
• At least 1 Data Science project experience.
• Excellent communication skills.

Responsibilities

• Hands-on Tier 2 production experience with Cloudera.
• Install and maintain CDP environments.
• Enable security requirements for CDP.
• Optimize cluster performance and Spark jobs.
• Collaborate with data engineers to boost Spark performance.
• Automate workflows and CI/CD pipelines (GitHub Actions, Jenkins, ArgoCD).
• Develop observability and monitoring capabilities.
• Containerization and management with Kubernetes/OpenShift.
• Automate patching and security checks.
• Shell/Terraform/Groovy scripting for automation.

Skills

Python

CI/CD Automation

Shell scripting

Observability

Agile engineering

Communication skills

Tools

Cloudera

CDP

Spark

Hive

Yarn

Ansible

Terraform

Groovy

Git

Docker

Kubernetes

OpenShift

Podman

GitHub Actions

Jenkins

ArgoCD

Job description

Job Descriptions:

• Hands on Tier 2 production experience with Cloudera:


• Installing and maintenance


• Enabling security requirements for CDP


• Optimizing cluster performance


• Working with data engineers to optimize Spark job performance


• Automation - Ansible, data/analytics jobs CI/CD


• Observability


• Installation, configuration and maintenance of the CDP latest version of CDP 7.1.9 or CDP latest version experience with Cloudera data services 1.5.4 and 1.5.5


• Trouble shooting the Spark job , Hive Jobs and Yarn jobs


• CDP Containerization with data services


• experience in writing automation using Shell, Terraform, Groovy and Ansible.


• Automated pipelines/workflows (GitHub Actions, Jenkins, ArgoCD etc.) for data projects. Python based preferred.


• Automating security/regulatory checks


• Automated patching


• Containerization - Podman, Docker, OCP ,


• Container Management - Kubernetes/OpenShift


• Linux OS & Networking basics


• Source control (git)


• Agile engineering and practices

Required Experience:

• At least 4 years production Hadoop experience


• 8+ years hands on Technology experience


• Experience with large and complex global enterprises defined by high availability, broad observability, and high level of reliability.


• At least 1 project experience in Data Science project/products


• Excellent communication and articulation skills