Clover Infotech - Hadoop Administrator

Clover Infotech; Bengaluru; On-site; INR 1,500,000 - 2,100,000; Full time

Job summary

Clover Infotech is seeking an experienced Data Platform Engineer to install, configure, and optimize Cloudera CDP environments in a Bengaluru data center. You will collaborate with data engineers to improve Spark performance and automate pipelines using GitHub Actions, Jenkins, or ArgoCD.

The role emphasizes automation, security, and observability of large-scale data jobs, with exposure to containerization and cloud-native tooling. Strong scripting skills and Linux basics are essential.

Qualifications

• At least 4 years of production Hadoop experience.
• Experience with Cloudera CDP and data services.
• Experience automating data projects via CI/CD.
• Strong scripting and automation capabilities in Shell, Python or Groovy.

Responsibilities

• Install, configure and maintain Cloudera CDP environments.
• Optimize cluster performance and security controls.
• Collaborate with data engineers to improve Spark job performance.
• Develop automation for pipelines and patch management.
• Ensure observability and reliability of data platforms.

Skills

Hadoop ecosystem

Cloudera CDP

Automation scripting

Shell scripting

Terraform / Ansible

CI/CD pipelines

Kubernetes/OpenShift

Linux administration

Python/Groovy

Education

Bachelor's degree in CS/IT or related field

Tools

Git

Jenkins

ArgoCD

Docker/Podman

Kubernetes

Job description

Job Description

• Installing and maintenance


• Enabling security requirements for CDP


• Optimizing cluster performance


• Working with data engineers to optimize Spark job performance


• Observability


• Installation, configuration and maintenance of the CDP latest version of CDP 7.1.9 or CDP latest version experience with Cloudera data services 1.5.4 and 1.5.5


• Trouble shooting the Spark job , Hive Jobs and Yarn jobs


• CDP Containerization with data services


• experience in writing automation using Shell, Terraform, Groovy and Ansible.


• Automated pipelines/workflows (GitHub Actions, Jenkins, ArgoCD etc.) for data projects. Python based preferred.


• Automating security/regulatory checks


• Automated patching


• Containerization - Podman, Docker, OCP ,


• Source control (git)


• Agile engineering and practices

Hands on Tier 2 production experience with Cloudera :

• Installing and maintenance


• Enabling security requirements for CDP


• Optimizing cluster performance


• Working with data engineers to optimize Spark job performance


• Automation - Ansible, data/analytics jobs CI/CD


• Observability


• Installation, configuration and maintenance of the CDP latest version of CDP 7.1.9 or CDP latest version experience with Cloudera data services 1.5.4 and 1.5.5


• Trouble shooting the Spark job , Hive Jobs and Yarn jobs


• CDP Containerization with data services


• experience in writing automation using Shell, Terraform, Groovy and Ansible.


• Automated pipelines/workflows (GitHub Actions, Jenkins, ArgoCD etc.) for data projects. Python based preferred.


• Automating security/regulatory checks


• Automated patching


• Containerization - Podman, Docker, OCP ,


• Container Management - Kubernetes/OpenShift


• Linux OS & Networking basics


• Source control (git)


• Agile engineering and practices

Required Experience

• At least 4 years production Hadoop experience


• 8+ years hands on Technology experience


• Experience with large and complex global enterprises defined by high availability, broad observability, and high level of reliability.


• At least 1 project experience in Data Science project/products


• Excellent communication and articulation skills

(ref:hirist.tech)