- UG: B.Tech/B.E. in Computer Science, Information Technology, or a related field
Job Description
Project Role Description: We are looking for an experienced Cloudera Administrator to install, configure, and manage Cloudera Data Platform (CDP) on a distributed cluster in a private cloud/data center environment. The candidate will be responsible for setting up and maintaining big data infrastructure, ensuring system performance, security, and availability across cluster components. The role requires strong expertise in cluster installation, configuration, monitoring, and administration of the Cloudera ecosystem.
Key Responsibilities:
- Install and configure Cloudera Data Platform (CDP) on a distributed cluster in a private cloud or on-premise data center.
- Deploy and manage Cloudera Manager for cluster administration and monitoring.
- Configure master nodes and worker/slave nodes in the cluster environment.
- Perform cluster provisioning, configuration, and upgrades.
Cloudera Ecosystem Administration
- Install, configure, and manage key components including Hue, Impala, Hive, Airflow, Atlas, and Ranger.
- Manage services for query processing, metadata management, and data governance.
Cluster Operations & Maintenance
- Monitor cluster health, performance, and resource utilization.
- Perform capacity planning, tuning, and optimization of big data workloads.
- Manage user access, authentication, and authorization using Ranger policies.
- Maintain high availability and reliability of the cluster environment.
Security & Governance
- Implement data governance and metadata management using Atlas.
- Configure security policies, access control, and auditing through Ranger.
- Ensure cluster security best practices are followed.
Troubleshooting & Support
- Troubleshoot issues related to cluster services, resource management, and performance.
- Diagnose and resolve failures across nodes, services, and data pipelines.
- Work with infrastructure teams to resolve network, storage, or compute issues.
- Document cluster architecture, configurations, and operational procedures.
- Work with data engineers, architects, and DevOps teams to support data platform operations.
Qualifications:
- Bachelor's degree in Computer Science, Information Technology, or related field.
- 4-8 years of experience in big data platform administration or Hadoop ecosystem management.
Required Skills:
- Hands-on experience with Cloudera Data Platform (CDP) installation and administration.
- Strong knowledge of Cloudera Manager for cluster management and monitoring.
- Experience configuring master nodes and worker/slave nodes in distributed clusters.
- Administration experience with Hue, Impala, Hive, Airflow, Atlas, and Ranger.
- Understanding of Linux system administration, networking, and storage in data center environments.
- Experience with cluster performance tuning and troubleshooting.
Preferred Skills:
- Experience deploying clusters in private cloud or hybrid environments.
- Familiarity with Kerberos, LDAP integration, and security frameworks.
- Knowledge of automation or scripting (Shell, Python) for cluster operations.
- Experience supporting data engineering workloads and ETL pipelines.